00010000:00010000:3.0F:1721219494.586740:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1721219494.938784:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511282624:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219494.938860:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511282752:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219494.938877:0:1837:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1721219494.938881:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511282688:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219494.938895:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8606d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511282816:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219494.939796:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511282688:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219494.939827:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8606d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511282816:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219494.939834:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511282624:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219494.939840:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511282752:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1721219495.588783:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0F:1721219496.031978:0:27662:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1721219496.031985:0:27662:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 23e: Append with next real comp: spillover and backward extension ========================================================== 08:31:35 (1721219495) 00000080:00200000:1.0F:1721219496.060344:0:27526:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219496.060363:0:27526:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219496.060375:0:27526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.060383:0:27526:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219496.060390:0:27526:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219496.060391:0:27526:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219496.060396:0:27526:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a9253af8 00010000:00010000:1.0:1721219496.060397:0:27526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.060402:0:27526:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219496.060411:0:27526:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:1.0:1721219496.060416:0:27526:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1 00000080:00200000:1.0:1721219496.060418:0:27526:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=getattr 00000002:00010000:1.0:1721219496.060423:0:27526:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1721219496.060450:0:27526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.060453:0:27526:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.060459:0:27526:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219496.060475:0:27526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:27526:1804827511282880:192.168.201.158@tcp:101:bash.0 00000100:00100000:1.0:1721219496.060532:0:27526:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5c00 going to sleep for 80 seconds 00000100:00100000:0.0:1721219496.061757:0:27526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:27526:1804827511282880:192.168.201.158@tcp:101:bash.0 00010000:00010000:0.0:1721219496.061765:0:27526:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061772:0:27526:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061775:0:27526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061778:0:27526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061795:0:27526:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061800:0:27526:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a81ce1c0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219496.061803:0:27526:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061808:0:27526:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061812:0:27526:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061816:0:27526:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219496.061818:0:27526:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061825:0:27526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ce1c0/0xe0b47d8ca5f72c5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219496.061836:0:27526:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a86297c0 x1804827511282880/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219577 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1721219496.061853:0:27526:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1721219496.061911:0:27526:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219496.061918:0:27526:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219496.061923:0:27526:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1721219496.061939:0:27526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061945:0:27526:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.061951:0:27526:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219496.061961:0:27526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:27526:1804827511282944:192.168.201.158@tcp:101:bash.0 00000100:00100000:0.0:1721219496.061986:0:27526:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7cd80 going to sleep for 80 seconds 00000100:00100000:0.0:1721219496.062717:0:27526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:27526:1804827511282944:192.168.201.158@tcp:101:bash.0 00010000:00010000:0.0:1721219496.062728:0:27526:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062735:0:27526:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062752:0:27526:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062759:0:27526:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062766:0:27526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062771:0:27526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062775:0:27526:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219496.062796:0:27526:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a92876c0 x1804827511282944/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 576/688 e 0 to 0 dl 1721219577 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:0.0:1721219496.062804:0:27526:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062811:0:27526:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1721219496.062825:0:27526:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 14848 00000080:00010000:0.0:1721219496.062829:0:27526:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f72c66 00000080:00010000:0.0:1721219496.062832:0:27526:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219496.062834:0:27526:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72c66 from it ffff8800a9253cf8 00010000:00010000:0.0:1721219496.062835:0:27526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219496.062849:0:27526:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219496.065170:0:27686:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219496.065177:0:27686:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219496.065182:0:27686:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065189:0:27686:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219496.065196:0:27686:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219496.065197:0:27686:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219496.065200:0:27686:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8ee3b58 00010000:00010000:1.0:1721219496.065202:0:27686:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065207:0:27686:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219496.065214:0:27686:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:1.0:1721219496.065220:0:27686:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1536 00000080:00200000:1.0:1721219496.065223:0:27686:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219496.065226:0:27686:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219496.065229:0:27686:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065235:0:27686:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219496.065240:0:27686:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219496.065245:0:27686:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219496.065248:0:27686:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8ee3bf8 00010000:00010000:1.0:1721219496.065250:0:27686:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065255:0:27686:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219496.065261:0:27686:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219496.065265:0:27686:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219496.065268:0:27686:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219496.065272:0:27686:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065277:0:27686:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219496.065282:0:27686:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219496.065284:0:27686:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219496.065286:0:27686:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8ee3da0 00010000:00010000:1.0:1721219496.065287:0:27686:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065292:0:27686:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219496.065297:0:27686:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219496.065300:0:27686:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8) 00800000:00000004:1.0:1721219496.065308:0:27686:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800af021000: age 1462, max_age 0 00010000:00010000:1.0:1721219496.065344:0:27686:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065354:0:27686:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219496.065372:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511283008:192.168.201.158@tcp:41:mkdir.0 00010000:00010000:1.0:1721219496.065375:0:27686:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219496.065381:0:27686:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219496.065382:0:27686:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72c66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e0020ed expref: -99 pid: 27526 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1721219496.065393:0:27686:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1721219496.065398:0:27686:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a862e3c0 x1804827511283136/t0(0) o36->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1721219496.065408:0:27686:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:27686:1804827511283136:192.168.201.158@tcp:36:mkdir.0 00000100:00100000:1.0:1721219496.065428:0:27686:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5b40 going to sleep for 80 seconds 00000100:00100000:0.0:1721219496.066267:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511283008:192.168.201.158@tcp:41:mkdir.0 00000100:00100000:1.0:1721219496.066977:0:27686:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:27686:1804827511283136:192.168.201.158@tcp:36:mkdir.0 00000080:00200000:1.0:1721219496.066994:0:27686:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a23:0x0](ffff8800b065b718) 00000080:00200000:1.0:1721219496.066997:0:27686:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a23:0x0], updating i_size 512 00010000:00010000:2.0:1721219496.590908:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219497.592901:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219498.594906:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219499.596878:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219499.946861:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283264:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219499.946885:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511283200:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219499.946919:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283392:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219499.946924:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8606d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511283328:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219499.948142:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511283200:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219499.948144:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283264:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219499.948151:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283392:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219499.948153:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8606d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511283328:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1721219500.598868:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219501.600763:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219502.602740:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219503.604845:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219504.606831:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219504.954857:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283520:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219504.954864:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511283456:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219504.954933:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511283584:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219504.954933:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8603440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283648:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219504.956276:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8603440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283648:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219504.956281:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511283456:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219504.956291:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511283584:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219504.956295:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511283520:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219505.325592:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219505.325688:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219505.325692:0:4606:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459630592 00000100:00100000:2.0:1721219505.325712:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459630656 00000100:00100000:3.0:1721219505.325724:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181530 00000100:00100000:3.0:1721219505.325728:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8604740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:20976:x1804827459630592:12345-192.168.201.158@tcp:104: 00000100:00100000:2.0:1721219505.325730:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181531 00000100:00100000:2.0:1721219505.325733:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8606880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:20976:x1804827459630656:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219505.325778:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1721219505.325781:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219505.325782:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8606880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:20976:x1804827459630656:12345-192.168.201.158@tcp:104: Request processed in 48us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219505.325784:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8604740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:20976:x1804827459630592:12345-192.168.201.158@tcp:104: Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219505.325786:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181531 00000100:00100000:3.0:1721219505.325788:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181530 00010000:00010000:3.0:1721219505.325806:0:11571:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1721219505.325809:0:11571:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9baf600/0xe0b47d8ca5f72c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e002030 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219505.325815:0:11546:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219505.325816:0:11571:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9baf600 already unused, calling callback (ffffffffa030c5c0) 00010000:00010000:1.0:1721219505.325819:0:11546:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e002037 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219505.325824:0:11571:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9baf600/0xe0b47d8ca5f72c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e002030 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219505.325824:0:11546:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dec000 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:1.0:1721219505.325836:0:11546:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e002037 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219505.325838:0:11571:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9baf600/0xe0b47d8ca5f72c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e002030 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219505.325842:0:11571:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9baf600/0xe0b47d8ca5f72c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e002030 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219505.325844:0:11571:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1721219505.325848:0:11546:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e002037 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219505.325851:0:11546:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e002037 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219505.325853:0:11546:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219505.325874:0:11571:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9baf600/0xe0b47d8ca5f72c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002030 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219505.325874:0:11546:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002037 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219505.325877:0:11571:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219505.325877:0:11546:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219505.325890:0:11546:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72c2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002037 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219505.325893:0:11546:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002037 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219505.325896:0:11571:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9baf600/0xe0b47d8ca5f72c27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002030 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219505.325899:0:11571:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9baf600/0xe0b47d8ca5f72c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002030 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219505.325901:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511283776:192.168.201.158@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219505.325904:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219505.325904:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219505.325905:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219505.325910:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219505.325911:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219505.325912:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219505.325915:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721219505.325922:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511283712:192.168.201.158@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1721219505.326506:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511283776:192.168.201.158@tcp:103:ldlm_bl_04.0 00000100:00100000:3.0:1721219505.326581:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511283712:192.168.201.158@tcp:103:ldlm_bl_05.0 00010000:00010000:2.0:1721219505.608882:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219506.610887:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1721219506.854755:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219506.854762:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 143 10000000:01000000:0.0:1721219506.854766:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219506.854800:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.854808:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.854816:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219506.854834:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511283840:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219506.854903:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219506.856379:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511283840:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219506.856394:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.856412:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219506.856455:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511283904:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219506.856487:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219506.857525:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511283904:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219506.857550:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511283968:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219506.857593:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219506.858641:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511283968:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219506.858915:0:27874:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27874:1804827511284032:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219506.858966:0:27874:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5d80 going to sleep for 6 seconds 00000100:00100000:1.0:1721219506.860238:0:27874:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27874:1804827511284032:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219506.860260:0:27874:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219506.860267:0:27874:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219506.860268:0:27874:0:(obd_config.c:1460:class_process_config()) marker 92 (0x1) lustre-clilov new lustre.test_23e 00000020:01000000:1.0:1721219506.860272:0:27874:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219506.860274:0:27874:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1721219506.860288:0:27874:0:(lov_pool.c:313:lov_pool_new()) test_23e is pool #2 00000100:00100000:1.0:1721219506.860306:0:27874:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27874:1804827511284096:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219506.860340:0:27874:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5300 going to sleep for 6 seconds 00000100:00100000:1.0:1721219506.861205:0:27874:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27874:1804827511284096:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219506.861224:0:27874:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219506.861227:0:27874:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219506.861229:0:27874:0:(obd_config.c:1460:class_process_config()) marker 92 (0x2) lustre-clilov new lustre.test_23e 00000040:00080000:1.0:1721219506.861231:0:27874:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 146 count 144 00000020:01000000:0.0:1721219506.861277:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 143-145 (rc=0) 10000000:01000000:0.0:1721219506.861293:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219506.861296:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.861302:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219506.861308:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219506.861309:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219506.861310:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219506.861320:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.861324:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.861328:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219506.861343:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284160:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219506.861365:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219506.862005:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284160:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219506.862013:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.862018:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219506.862039:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284224:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219506.862063:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219506.862760:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284224:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219506.862775:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219506.862777:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219506.862783:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219507.612777:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219507.814712:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219507.814750:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219507.814782:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459634752 00000100:00100000:2.0:1721219507.814782:0:4606:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459634240 00000100:00100000:2.0:1721219507.814807:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181532 00000100:00100000:2.0:1721219507.814811:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86050c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:21200:x1804827459634240:12345-192.168.201.158@tcp:104: 00000100:00100000:3.0:1721219507.814815:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181533 00000100:00100000:3.0:1721219507.814819:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86076c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:21200:x1804827459634752:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219507.814861:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219507.814864:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86050c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:21200:x1804827459634240:12345-192.168.201.158@tcp:104: Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219507.814869:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181532 00010000:00010000:3.0:1721219507.814871:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219507.814876:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86076c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+3:21200:x1804827459634752:12345-192.168.201.158@tcp:104: Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219507.814883:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181533 00010000:00010000:3.0:1721219507.814899:0:9881:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1721219507.814904:0:9881:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219507.814912:0:9881:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def3c0 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:3.0:1721219507.814915:0:9881:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219507.814921:0:4613:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219507.814922:0:9881:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219507.814924:0:4613:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219507.814927:0:9881:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219507.814930:0:4613:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dee400 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219507.814931:0:4613:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219507.814932:0:9881:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219507.814943:0:4613:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219507.814946:0:4613:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219507.814949:0:4613:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219507.814971:0:4613:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219507.814972:0:9881:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219507.814974:0:4613:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219507.814977:0:9881:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219507.814987:0:4613:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219507.814990:0:4613:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72c6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002109 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219507.814992:0:9881:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219507.814997:0:9881:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e002110 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219507.815000:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219507.815001:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219507.815002:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219507.815010:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511284352:192.168.201.158@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1721219507.815013:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219507.815014:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219507.815015:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511284288:192.168.201.158@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1721219507.815019:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219507.815613:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511284288:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1721219507.815623:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511284352:192.168.201.158@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1721219508.614860:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1721219509.114783:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219509.114789:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 146 10000000:01000000:2.0:1721219509.114793:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219509.114823:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bae1c0/0xe0b47d8ca5f72c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219509.114830:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9bae1c0/0xe0b47d8ca5f72c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219509.114836:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9bae1c0/0xe0b47d8ca5f72c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219509.114853:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8602140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284416:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219509.114939:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162840 going to sleep for 6 seconds 00000100:00100000:0.0:1721219509.116263:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8602140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284416:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219509.116276:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9bae1c0/0xe0b47d8ca5f72c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0021e2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219509.116285:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9bae1c0/0xe0b47d8ca5f72c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0021e2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219509.116331:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284480:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219509.116365:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c6c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219509.117194:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284480:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219509.117219:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284544:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219509.117261:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c6c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219509.118108:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284544:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219509.118342:0:27919:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27919:1804827511284608:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219509.118379:0:27919:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e59c0 going to sleep for 6 seconds 00000100:00100000:1.0:1721219509.119384:0:27919:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27919:1804827511284608:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219509.119404:0:27919:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219509.119409:0:27919:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219509.119410:0:27919:0:(obd_config.c:1460:class_process_config()) marker 94 (0x1) lustre-clilov add lustre.test_23e.lustre-OST0000_UUID 00000020:01000000:1.0:1721219509.119413:0:27919:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219509.119415:0:27919:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1721219509.119422:0:27919:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_23e as member 1 00000100:00100000:1.0:1721219509.119434:0:27919:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27919:1804827511284672:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219509.119466:0:27919:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e59c0 going to sleep for 6 seconds 00000100:00100000:1.0:1721219509.120158:0:27919:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:27919:1804827511284672:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219509.120178:0:27919:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219509.120181:0:27919:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219509.120186:0:27919:0:(obd_config.c:1460:class_process_config()) marker 94 (0x2) lustre-clilov add lustre.test_23e.lustre-OST0000_UUID 00000040:00080000:1.0:1721219509.120189:0:27919:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 149 count 147 00000020:01000000:0.0:1721219509.120241:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 146-148 (rc=0) 10000000:01000000:0.0:1721219509.120257:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219509.120261:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bae1c0/0xe0b47d8ca5f72c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0021e2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219509.120268:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9bae1c0/0xe0b47d8ca5f72c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0021e2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219509.120274:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219509.120275:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219509.120277:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219509.120288:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219509.120293:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219509.120298:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219509.120307:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284736:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219509.120332:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c6c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219509.121012:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284736:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219509.121022:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0021e9 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219509.121032:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0021e9 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219509.121058:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284800:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219509.121088:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7c6c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219509.121829:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511284800:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219509.121844:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219509.121847:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0021e9 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219509.121853:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0021e9 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219509.616804:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219509.962801:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511284928:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219509.962811:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8602140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511284864:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219509.962855:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8606d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511285056:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219509.962857:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8603440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511284992:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219509.963891:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511284928:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219509.963894:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8602140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511284864:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219509.963900:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8606d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511285056:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219509.963902:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8603440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511284992:192.168.201.158@tcp:400:kworker/u8:1.0 00000080:00200000:3.0:1721219510.070539:0:27940:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219510.070567:0:27940:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219510.070579:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.070592:0:27940:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219510.070602:0:27940:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219510.070605:0:27940:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219510.070610:0:27940:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a931baf8 00010000:00010000:3.0:1721219510.070613:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.070617:0:27940:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219510.070627:0:27940:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219510.070637:0:27940:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=16 00000080:00200000:3.0:1721219510.070640:0:27940:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=0 00000002:00010000:3.0:1721219510.070645:0:27940:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219510.070708:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.070716:0:27940:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.070724:0:27940:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219510.070741:0:27940:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285120:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219510.070798:0:27940:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940180 going to sleep for 80 seconds 00000100:00100000:3.0:1721219510.072513:0:27940:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285120:192.168.201.158@tcp:101:lfs.0 00010000:00010000:3.0:1721219510.072523:0:27940:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072532:0:27940:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072536:0:27940:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072542:0:27940:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072546:0:27940:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072573:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072576:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072579:0:27940:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219510.072585:0:27940:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a8986880 x1804827511285120/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219591 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1721219510.072598:0:27940:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072602:0:27940:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589935617/27171 (0 0) 00000080:00200000:3.0:1721219510.072613:0:27940:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a23:0x0], updating i_size 11776 00000080:00200000:3.0:1721219510.072614:0:27940:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6a23:0x0](ffff8800b065b718): rc = 0 00000080:00010000:3.0:1721219510.072618:0:27940:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a23:0x0](ffff8800b065b718) for lock 0xe0b47d8ca5f72c89 00000080:00010000:3.0:1721219510.072622:0:27940:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x6a23:0x0](ffff8800b065b718) 00000080:00010000:3.0:1721219510.072623:0:27940:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72c89 from it ffff8800a931ba70 00010000:00010000:3.0:1721219510.072624:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072628:0:27940:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219510.072640:0:27940:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a23:0x0](ffff8800b065b718), inode mode 41ed mask 1 00000080:00200000:3.0:1721219510.072650:0:27940:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x6a23:0x0](ffff8800b065b718), flags=0 00000080:00200000:3.0:1721219510.072670:0:27940:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x6a23:0x0](ffff8800b065b718), intent=getattr 00000002:00010000:3.0:1721219510.072677:0:27940:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x6a23:0x0], intent: getattr flags 0 00010000:00010000:3.0:1721219510.072694:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072700:0:27940:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.072706:0:27940:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219510.072717:0:27940:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285184:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219510.072746:0:27940:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940180 going to sleep for 80 seconds 00000100:00100000:3.0:1721219510.073684:0:27940:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285184:192.168.201.158@tcp:101:lfs.0 00010000:00010000:3.0:1721219510.073691:0:27940:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073698:0:27940:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073701:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073705:0:27940:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073708:0:27940:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073716:0:27940:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8030000 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:3.0:1721219510.073719:0:27940:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073722:0:27940:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073725:0:27940:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073729:0:27940:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1721219510.073731:0:27940:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073734:0:27940:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8030000/0xe0b47d8ca5f72c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219510.073740:0:27940:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a8986880 x1804827511285184/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219591 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:3.0:1721219510.073751:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073755:0:27940:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219510.073758:0:27940:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72c89 from it ffff8800a931b9f0 00010000:00010000:3.0:1721219510.073759:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073768:0:27940:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219510.073791:0:27940:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219510.073795:0:27940:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219510.073798:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073801:0:27940:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219510.073805:0:27940:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219510.073806:0:27940:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219510.073808:0:27940:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a931bbb0 00010000:00010000:3.0:1721219510.073808:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073811:0:27940:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219510.073815:0:27940:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219510.073817:0:27940:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d23e.sanity-pfl, flags=17 00000080:00200000:3.0:1721219510.073819:0:27940:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a23:0x0](ffff8800b065b718), inode mode 41ed mask 1 00000080:00200000:3.0:1721219510.073821:0:27940:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f23e.sanity-pfl, flags=769 00000080:00200000:3.0:1721219510.073822:0:27940:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a23:0x0](ffff8800b065b718), inode mode 41ed mask 3 00000080:00200000:3.0:1721219510.073824:0:27940:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x6a23:0x0](ffff8800b065b718), file ffff8800ab6b0480, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1721219510.073828:0:27940:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x6a23:0x0](ffff8800b065b718), intent=open|creat 00000002:00010000:3.0:1721219510.073838:0:27940:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23e.sanity-pfl,[0x200000401:0x6a24:0x0]) in obj [0x200000401:0x6a23:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1721219510.073843:0:27940:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073863:0:27940:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073867:0:27940:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219510.073868:0:27940:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031b00/0xe0b47d8ca5f72c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a23:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e002205 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073878:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.073881:0:27940:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1721219510.073887:0:27940:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1721219510.073890:0:27940:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8986880 x1804827511285312/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1721219510.073894:0:27940:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219510.073901:0:27940:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285312:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219510.073967:0:27940:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940180 going to sleep for 80 seconds 00000100:00100000:3.0:1721219510.075449:0:27940:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8986880 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285312:192.168.201.158@tcp:101:lfs.0 00010000:00010000:3.0:1721219510.075457:0:27940:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075474:0:27940:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075477:0:27940:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075481:0:27940:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075484:0:27940:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075489:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075493:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075498:0:27940:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219510.075504:0:27940:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a8986880 x1804827511285312/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219591 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:3.0:1721219510.075513:0:27940:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a8986880 x1804827511285312/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219591 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1721219510.075519:0:27940:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075535:0:27940:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 16 res 8589935617/27172 (0 0) 00000080:00200000:3.0:1721219510.075543:0:27940:0:(namei.c:1405:ll_create_it()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x6a23:0x0](ffff8800b065b718), intent=open|creat 00000080:00200000:3.0:1721219510.075571:0:27940:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a24:0x0](ffff88012e487518) 00000080:00200000:3.0:1721219510.075575:0:27940:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a24:0x0], updating i_size 0 00000080:00200000:3.0:1721219510.075598:0:27940:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x6a24:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1721219510.075600:0:27940:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x6a24:0x0](ffff88012e487518) 00000080:00010000:3.0:1721219510.075602:0:27940:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a24:0x0](ffff88012e487518) for lock 0xe0b47d8ca5f72c97 00000080:00200000:3.0:1721219510.075607:0:27940:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x6a24:0x0](ffff88012e487518), flags 120501 00000002:00100000:3.0:1721219510.075615:0:27940:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a8986880 x1804827511285312/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219591 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:3.0:1721219510.075640:0:27940:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72c97 from it ffff880136981960 00010000:00010000:3.0:1721219510.075642:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075646:0:27940:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219510.075669:0:27940:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a24:0x0](ffff88012e487518), inode mode 81a4 mask 40 00000080:00200000:3.0:1721219510.075696:0:27940:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a24:0x0](ffff88012e487518), inode mode 81a4 mask 2 00000080:00200000:3.0:1721219510.075701:0:27940:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x6a24:0x0](ffff88012e487518), xattr lov 00000002:00010000:3.0:1721219510.075707:0:27940:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x6a24:0x0]) in obj [0x200000401:0x6a23:0x0], intent: open flags 040000002 00010000:00010000:3.0:1721219510.075722:0:27940:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.075726:0:27940:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1721219510.075738:0:27940:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1721219510.075740:0:27940:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8985580 x1804827511285440/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1721219510.075744:0:27940:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219510.075751:0:27940:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985580 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285440:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219510.075790:0:27940:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940180 going to sleep for 80 seconds 00000100:00100000:2.0:1721219510.076567:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219510.076613:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459636608 00000100:00100000:3.0:1721219510.076647:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181534 00000100:00100000:3.0:1721219510.076670:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8606d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27341:x1804827459636608:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219510.076708:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1721219510.076713:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8606d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27341:x1804827459636608:12345-192.168.201.158@tcp:104: Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219510.076720:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181534 00010000:00010000:3.0:1721219510.076736:0:4614:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219510.076739:0:4614:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.076745:0:4614:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a80333c0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:3.0:1721219510.076746:0:4614:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.076750:0:4614:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.076760:0:4614:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219510.076769:0:4614:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x6a24:0x0]: losing layout lock 00010000:00010000:3.0:1721219510.076781:0:4614:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.076784:0:4614:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219510.076795:0:4614:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.076800:0:4614:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a80333c0/0xe0b47d8ca5f72c97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a24:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e002236 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219510.076810:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219510.076811:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219510.076813:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219510.076821:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511285504:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219510.077636:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511285504:192.168.201.158@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1721219510.618847:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219511.620865:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219512.622901:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219513.624819:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219514.626834:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219514.970855:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511285568:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219514.970859:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511285632:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219514.970915:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511285696:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219514.970916:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8607200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511285760:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219514.972213:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511285568:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219514.972220:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511285632:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219514.972221:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511285696:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219514.972236:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8607200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511285760:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1721219515.628843:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219516.630821:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219517.632847:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219518.634858:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219519.636852:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219519.978881:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511285888:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219519.978882:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511285824:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219519.978952:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92850c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511285952:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219519.978952:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286016:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219519.980360:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286016:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219519.980373:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511285888:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219519.980415:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511285824:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219519.980426:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92850c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511285952:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1721219520.638859:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219521.640873:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219522.642785:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219523.644836:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219524.646836:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219524.986841:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286144:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219524.986855:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511286080:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219524.986905:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9283440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511286208:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219524.986910:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286272:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219524.988235:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511286080:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219524.988238:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286272:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219524.988247:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9283440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511286208:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219524.988251:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286144:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1721219525.648848:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219526.650845:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219527.652755:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219528.654866:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219529.656846:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219529.994841:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286400:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219529.994850:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511286336:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219529.994912:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286528:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219529.994913:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511286464:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219529.996300:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511286336:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219529.996304:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286400:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219529.996310:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511286464:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219529.996311:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511286528:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219530.078187:0:27940:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985580 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511285440:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219530.078202:0:27940:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078211:0:27940:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078227:0:27940:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078231:0:27940:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078235:0:27940:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078238:0:27940:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8033a80 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219530.078240:0:27940:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078244:0:27940:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078266:0:27940:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078270:0:27940:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219530.078272:0:27940:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219530.078275:0:27940:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8033a80/0xe0b47d8ca5f72c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a23:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27940 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219530.078301:0:27940:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a8985580 x1804827511285440/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/600 e 0 to 0 dl 1721219591 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1721219530.078314:0:27940:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1721219530.078378:0:27940:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x6a24:0x0](ffff88012e487518) 00000002:00100000:0.0:1721219530.078398:0:27940:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a8986880 x1804827511285312/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219591 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1721219530.078412:0:27940:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1721219530.078415:0:27940:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a92804c0 x1804827511286656/t0(0) o35->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1721219530.078427:0:27940:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511286656:192.168.201.158@tcp:35:lfs.0 00000100:00100000:0.0:1721219530.078469:0:27940:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6d7cd80 going to sleep for 6 seconds 00000100:00100000:0.0:1721219530.079636:0:27940:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:27940:1804827511286656:192.168.201.158@tcp:35:lfs.0 00000002:00100000:0.0:1721219530.079647:0:27940:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a8986880 x1804827511285312/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219591 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000400:00000080:1.0:1721219530.376763:0:28088:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219530.376765:0:28088:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_23e: @@@@@@ FAIL: Create /mnt/lustre/d23e.sanity-pfl/f23e.sanity-pfl failed 00010000:00010000:3.0:1721219530.658768:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 586 lines, 586 kept, 0 dropped, 0 bad.