00010000:00010000:3.0F:1721219427.450824:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1721219428.452874:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219429.454890:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1721219429.834861:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511275328:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0F:1721219429.834938:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511275264:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219429.834987:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511275456:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219429.835016:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511275392:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219429.836651:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511275264:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219429.836708:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511275392:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219429.836760:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511275328:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219429.836773:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511275456:192.168.201.158@tcp:400:kworker/u8:2.0 00000400:00000080:1.0:1721219429.987579:0:25781:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219429.987584:0:25781:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 23c: Append with low on space + 0-length comp: force extension ========================================================== 08:30:29 (1721219429) 00000080:00200000:0.0:1721219430.036853:0:25645:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219430.036874:0:25645:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219430.036921:0:25645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.036938:0:25645:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219430.036950:0:25645:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219430.036953:0:25645:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219430.037000:0:25645:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012dc77af8 00010000:00010000:0.0:1721219430.037004:0:25645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.037012:0:25645:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219430.037028:0:25645:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219430.037037:0:25645:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1 00000080:00200000:0.0:1721219430.037040:0:25645:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=getattr 00000002:00010000:0.0:1721219430.037049:0:25645:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219430.037090:0:25645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.037106:0:25645:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.037116:0:25645:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219430.037141:0:25645:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:25645:1804827511275520:192.168.201.158@tcp:101:bash.0 00000100:00100000:0.0:1721219430.037231:0:25645:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0a80 going to sleep for 80 seconds 00000100:00100000:0.0:1721219430.039781:0:25645:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:25645:1804827511275520:192.168.201.158@tcp:101:bash.0 00010000:00010000:0.0:1721219430.039796:0:25645:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039808:0:25645:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039815:0:25645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039821:0:25645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039828:0:25645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039835:0:25645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def600 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219430.039838:0:25645:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039858:0:25645:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039864:0:25645:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039870:0:25645:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219430.039874:0:25645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.039880:0:25645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219430.039923:0:25645:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a9284740 x1804827511275520/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219511 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1721219430.039946:0:25645:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1721219430.040032:0:25645:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219430.040041:0:25645:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219430.040046:0:25645:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1721219430.040067:0:25645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.040074:0:25645:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.040081:0:25645:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219430.040094:0:25645:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:25645:1804827511275584:192.168.201.158@tcp:101:bash.0 00000100:00100000:0.0:1721219430.040157:0:25645:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0a80 going to sleep for 80 seconds 00000100:00100000:2.0:1721219430.041835:0:25645:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:25645:1804827511275584:192.168.201.158@tcp:101:bash.0 00010000:00010000:2.0:1721219430.041850:0:25645:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041861:0:25645:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041871:0:25645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041879:0:25645:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041911:0:25645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041917:0:25645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041923:0:25645:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1721219430.041931:0:25645:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a9284740 x1804827511275584/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 576/688 e 0 to 0 dl 1721219511 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:2.0:1721219430.041941:0:25645:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041950:0:25645:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1721219430.041971:0:25645:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 14848 00000080:00010000:2.0:1721219430.041984:0:25645:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f72bda 00000080:00010000:2.0:1721219430.041989:0:25645:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:2.0:1721219430.041991:0:25645:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72bda from it ffff88012dc77cf8 00010000:00010000:2.0:1721219430.041993:0:25645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219430.041999:0:25645:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219430.045606:0:25805:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219430.045618:0:25805:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219430.045627:0:25805:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045638:0:25805:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219430.045647:0:25805:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219430.045649:0:25805:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219430.045680:0:25805:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a9073b58 00010000:00010000:0.0:1721219430.045683:0:25805:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045690:0:25805:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219430.045700:0:25805:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219430.045708:0:25805:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1536 00000080:00200000:0.0:1721219430.045711:0:25805:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219430.045715:0:25805:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219430.045719:0:25805:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045725:0:25805:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219430.045732:0:25805:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219430.045739:0:25805:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219430.045743:0:25805:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a9073bf8 00010000:00010000:0.0:1721219430.045745:0:25805:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045751:0:25805:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219430.045758:0:25805:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:0.0:1721219430.045763:0:25805:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219430.045766:0:25805:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219430.045770:0:25805:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045776:0:25805:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219430.045782:0:25805:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219430.045784:0:25805:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219430.045786:0:25805:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a9073da0 00010000:00010000:0.0:1721219430.045788:0:25805:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045793:0:25805:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219430.045799:0:25805:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:0.0:1721219430.045802:0:25805:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8) 00800000:00000004:0.0:1721219430.045813:0:25805:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800af021000: age 1462, max_age 0 00010000:00010000:0.0:1721219430.045868:0:25805:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045882:0:25805:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045931:0:25805:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219430.045937:0:25805:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219430.045939:0:25805:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72bda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001deb expref: -99 pid: 25645 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219430.045953:0:25805:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1721219430.045960:0:25805:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9284280 x1804827511275776/t0(0) o36->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1721219430.045975:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511275648:192.168.201.158@tcp:41:mkdir.0 00000100:00100000:0.0:1721219430.045975:0:25805:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284280 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:25805:1804827511275776:192.168.201.158@tcp:36:mkdir.0 00000100:00100000:0.0:1721219430.046022:0:25805:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0600 going to sleep for 80 seconds 00000100:00100000:1.0:1721219430.047919:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511275648:192.168.201.158@tcp:41:mkdir.0 00000100:00100000:0.0:1721219430.048813:0:25805:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284280 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:25805:1804827511275776:192.168.201.158@tcp:36:mkdir.0 00000080:00200000:0.0:1721219430.048838:0:25805:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a1f:0x0](ffff8800b06180d8) 00000080:00200000:0.0:1721219430.048843:0:25805:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a1f:0x0], updating i_size 512 00010000:00010000:1.0:1721219430.456907:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219431.458972:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219432.460824:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219433.463008:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219434.464905:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219434.842891:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511275904:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219434.842910:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511275840:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219434.842982:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511276032:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219434.842983:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511275968:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219434.845045:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511275968:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219434.845067:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511275840:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219434.845071:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511275904:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219434.845084:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511276032:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1721219435.466862:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219436.468798:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219437.470862:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219438.472843:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219439.475050:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219439.754317:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219439.754381:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219439.754447:0:4606:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1721219439.754480:0:4606:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459613248 00000100:00100000:1.0:1721219439.754528:0:4603:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459613312 00000100:00100000:3.0:1721219439.754558:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181521 00000100:00100000:3.0:1721219439.754569:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18395:x1804827459613248:12345-192.168.201.158@tcp:104: 00000100:00100000:1.0:1721219439.754591:0:4603:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 9881 00000100:00100000:1.0:1721219439.754601:0:4603:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86017c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18395:x1804827459613312:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219439.754751:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1721219439.754758:0:4603:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219439.754762:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18395:x1804827459613248:12345-192.168.201.158@tcp:104: Request processed in 193us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219439.754766:0:4603:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86017c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18395:x1804827459613312:12345-192.168.201.158@tcp:104: Request processed in 166us (385us total) trans 0 rc 0/0 00010000:00010000:0.0:1721219439.754769:0:4614:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1721219439.754775:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181521 00010000:00010000:0.0:1721219439.754787:0:4614:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001ca2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219439.754790:0:4603:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 9881 00010000:00010000:0.0:1721219439.754800:0:4614:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deef40 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219439.754804:0:4614:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001ca2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219439.754807:0:11574:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219439.754812:0:4614:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001ca2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219439.754813:0:11574:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001c9b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219439.754818:0:4614:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001ca2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219439.754822:0:4614:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219439.754824:0:11574:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dee400 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:2.0:1721219439.754826:0:11574:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001c9b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219439.754833:0:11574:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001c9b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219439.754841:0:11574:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001c9b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219439.754846:0:11574:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219439.754862:0:4614:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001ca2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219439.754868:0:4614:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219439.754873:0:11574:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001c9b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219439.754878:0:11574:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219439.754883:0:4614:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72b78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001ca2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219439.754889:0:4614:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f72b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001ca2 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219439.754899:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511276096:192.168.201.158@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1721219439.754907:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219439.754908:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219439.754910:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219439.754913:0:11574:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72b71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001c9b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219439.754919:0:11574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001c9b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219439.754938:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219439.754939:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219439.754941:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219439.754948:0:1837:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721219439.754961:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511276160:192.168.201.158@tcp:103:ldlm_bl_07.0 00000100:00100000:3.0:1721219439.756004:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511276160:192.168.201.158@tcp:103:ldlm_bl_07.0 00000100:00100000:1.0:1721219439.756112:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511276096:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219439.850803:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511276288:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219439.850837:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511276224:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219439.850865:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511276352:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219439.852223:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511276352:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219439.852238:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511276288:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219439.852248:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511276224:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1721219440.476895:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1721219440.884755:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1721219440.884762:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 130 10000000:01000000:1.0:1721219440.884766:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1721219440.884801:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219440.884811:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219440.884819:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219440.884840:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276416:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1721219440.884915:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219440.886572:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276416:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219440.886589:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219440.886597:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219440.886679:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276480:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219440.886734:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:2.0:1721219440.887841:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276480:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219440.887878:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276544:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219440.887935:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b61626c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219440.889043:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276544:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219440.889282:0:25993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:25993:1804827511276608:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219440.889333:0:25993:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5c00 going to sleep for 6 seconds 00000100:00100000:1.0:1721219440.890650:0:25993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:25993:1804827511276608:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219440.890693:0:25993:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219440.890699:0:25993:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219440.890700:0:25993:0:(obd_config.c:1460:class_process_config()) marker 84 (0x1) lustre-clilov new lustre.test_23c 00000020:01000000:1.0:1721219440.890719:0:25993:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219440.890721:0:25993:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1721219440.890737:0:25993:0:(lov_pool.c:313:lov_pool_new()) test_23c is pool #2 00000100:00100000:1.0:1721219440.890753:0:25993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:25993:1804827511276672:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219440.890793:0:25993:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e59c0 going to sleep for 6 seconds 00000100:00100000:1.0:1721219440.891913:0:25993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:25993:1804827511276672:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219440.891934:0:25993:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219440.891937:0:25993:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219440.891938:0:25993:0:(obd_config.c:1460:class_process_config()) marker 84 (0x2) lustre-clilov new lustre.test_23c 00000040:00080000:1.0:1721219440.891941:0:25993:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 133 count 132 00000020:01000000:0.0:1721219440.891999:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 130-132 (rc=0) 10000000:01000000:0.0:1721219440.892015:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219440.892019:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219440.892029:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219440.892037:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219440.892039:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219440.892041:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219440.892057:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219440.892063:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219440.892071:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219440.892086:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276736:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219440.892126:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0180 going to sleep for 6 seconds 00000100:00100000:0.0:1721219440.893066:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276736:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219440.893076:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219440.893091:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219440.893122:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276800:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219440.893154:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0180 going to sleep for 6 seconds 00000100:00100000:0.0:1721219440.894110:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276800:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219440.894128:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219440.894131:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219440.894137:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219441.478895:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219442.353259:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219442.353296:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219442.353326:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459616960 00000100:00100000:2.0:1721219442.353326:0:4606:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459616896 00000100:00100000:2.0:1721219442.353354:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181522 00000100:00100000:3.0:1721219442.353359:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181523 00000100:00100000:2.0:1721219442.353359:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8984280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18647:x1804827459616896:12345-192.168.201.158@tcp:104: 00000100:00100000:3.0:1721219442.353363:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8982ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18647:x1804827459616960:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219442.353412:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1721219442.353415:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219442.353417:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8982ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18647:x1804827459616960:12345-192.168.201.158@tcp:104: Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219442.353418:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8984280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:18647:x1804827459616896:12345-192.168.201.158@tcp:104: Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219442.353423:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181523 00000100:00100000:2.0:1721219442.353426:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181522 00010000:00010000:2.0:1721219442.353443:0:4613:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1721219442.353446:0:4613:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219442.353454:0:4613:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a81ce1c0 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:2.0:1721219442.353456:0:4613:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219442.353470:0:4613:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219442.353473:0:4613:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219442.353476:0:4613:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1721219442.353480:0:11546:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1721219442.353484:0:11546:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219442.353490:0:11546:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dee400 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:1.0:1721219442.353491:0:11546:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219442.353503:0:11546:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219442.353507:0:11546:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219442.353508:0:4613:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219442.353509:0:11546:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219442.353513:0:4613:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219442.353521:0:11546:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219442.353524:0:11546:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219442.353531:0:4613:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219442.353536:0:4613:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a81ce1c0/0xe0b47d8ca5f72be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001e07 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219442.353541:0:11546:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219442.353544:0:11546:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001e0e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219442.353549:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219442.353551:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219442.353552:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219442.353554:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219442.353555:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219442.353556:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219442.353557:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8603900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511276864:192.168.201.158@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1721219442.353562:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511276928:192.168.201.158@tcp:103:ldlm_bl_04.0 00000100:00100000:2.0:1721219442.354170:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8603900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511276864:192.168.201.158@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1721219442.354182:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511276928:192.168.201.158@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1721219442.480848:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1721219442.638760:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219442.638765:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 133 10000000:01000000:0.0:1721219442.638769:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219442.638802:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.638809:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.638815:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219442.638846:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276992:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219442.638909:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0240 going to sleep for 6 seconds 00000100:00100000:0.0:1721219442.640212:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511276992:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219442.640225:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e7e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.640232:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001e7e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219442.640268:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277056:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219442.640294:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0240 going to sleep for 6 seconds 00000100:00100000:0.0:1721219442.641031:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277056:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219442.641053:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277120:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219442.641091:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0240 going to sleep for 6 seconds 00000100:00100000:0.0:1721219442.642075:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277120:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219442.642329:0:26037:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:26037:1804827511277184:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219442.642366:0:26037:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5cc0 going to sleep for 6 seconds 00000100:00100000:1.0:1721219442.643459:0:26037:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:26037:1804827511277184:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219442.643478:0:26037:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219442.643483:0:26037:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219442.643485:0:26037:0:(obd_config.c:1460:class_process_config()) marker 86 (0x1) lustre-clilov add lustre.test_23c.lustre-OST0000_UUID 00000020:01000000:1.0:1721219442.643488:0:26037:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219442.643489:0:26037:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1721219442.643497:0:26037:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_23c as member 1 00000100:00100000:1.0:1721219442.643514:0:26037:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:26037:1804827511277248:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219442.643546:0:26037:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5cc0 going to sleep for 6 seconds 00000100:00100000:1.0:1721219442.644343:0:26037:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:26037:1804827511277248:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219442.644368:0:26037:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:26037:1804827511277312:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219442.644400:0:26037:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5cc0 going to sleep for 6 seconds 00000100:00100000:1.0:1721219442.645071:0:26037:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:26037:1804827511277312:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219442.645087:0:26037:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219442.645090:0:26037:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219442.645091:0:26037:0:(obd_config.c:1460:class_process_config()) marker 86 (0x2) lustre-clilov add lustre.test_23c.lustre-OST0000_UUID 00000040:00080000:1.0:1721219442.645093:0:26037:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 137 count 135 00000020:01000000:0.0:1721219442.645129:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 133-136 (rc=0) 10000000:01000000:0.0:1721219442.645144:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219442.645147:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e7e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.645154:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e7e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219442.645161:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219442.645168:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219442.645170:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219442.645181:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.645186:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.645192:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219442.645203:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277376:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219442.645233:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0240 going to sleep for 6 seconds 00000100:00100000:0.0:1721219442.645985:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277376:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219442.645994:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e85 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.645999:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001e85 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219442.646020:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277440:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219442.646046:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0240 going to sleep for 6 seconds 00000100:00100000:0.0:1721219442.646817:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511277440:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219442.646831:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219442.646834:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e85 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219442.646839:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001e85 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219443.482868:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219444.484729:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1721219444.601900:0:26060:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219444.601914:0:26060:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219444.601926:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.601937:0:26060:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219444.601945:0:26060:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219444.601947:0:26060:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219444.601953:0:26060:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800af257af8 00010000:00010000:3.0:1721219444.601955:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.601961:0:26060:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219444.601983:0:26060:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219444.601991:0:26060:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=16 00000080:00200000:3.0:1721219444.601994:0:26060:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=0 00000002:00010000:3.0:1721219444.602000:0:26060:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219444.602032:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.602038:0:26060:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.602046:0:26060:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219444.602068:0:26060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89876c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277504:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219444.602131:0:26060:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940240 going to sleep for 80 seconds 00000100:00100000:0.0:1721219444.603693:0:26060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89876c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277504:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219444.603704:0:26060:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603715:0:26060:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603721:0:26060:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603728:0:26060:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603735:0:26060:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603742:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603747:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603752:0:26060:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219444.603760:0:26060:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a89876c0 x1804827511277504/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219525 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219444.603769:0:26060:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603780:0:26060:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589935617/27167 (0 0) 00000080:00200000:0.0:1721219444.603792:0:26060:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a1f:0x0], updating i_size 11776 00000080:00200000:0.0:1721219444.603794:0:26060:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6a1f:0x0](ffff8800b06180d8): rc = 0 00000080:00010000:0.0:1721219444.603799:0:26060:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a1f:0x0](ffff8800b06180d8) for lock 0xe0b47d8ca5f72bfd 00000080:00010000:0.0:1721219444.603805:0:26060:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x6a1f:0x0](ffff8800b06180d8) 00000080:00010000:0.0:1721219444.603807:0:26060:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72bfd from it ffff8800af257a70 00010000:00010000:0.0:1721219444.603809:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603815:0:26060:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219444.603830:0:26060:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219444.603836:0:26060:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), flags=0 00000080:00200000:0.0:1721219444.603838:0:26060:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), intent=getattr 00000002:00010000:0.0:1721219444.603844:0:26060:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x6a1f:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219444.603860:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603865:0:26060:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.603871:0:26060:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219444.603881:0:26060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277568:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219444.603914:0:26060:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0d80 going to sleep for 80 seconds 00000100:00100000:0.0:1721219444.604854:0:26060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277568:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219444.604862:0:26060:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604868:0:26060:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604873:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604878:0:26060:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604883:0:26060:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604889:0:26060:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deeac0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219444.604891:0:26060:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604897:0:26060:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604902:0:26060:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604907:0:26060:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219444.604910:0:26060:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604927:0:26060:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219444.604938:0:26060:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a9287200 x1804827511277568/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219525 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:0.0:1721219444.604952:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604958:0:26060:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219444.604964:0:26060:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72bfd from it ffff8800af2579f0 00010000:00010000:0.0:1721219444.604966:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.604972:0:26060:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219444.605000:0:26060:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219444.605005:0:26060:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219444.605010:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.605015:0:26060:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219444.605021:0:26060:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219444.605023:0:26060:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219444.605030:0:26060:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800af257bb0 00010000:00010000:0.0:1721219444.605031:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.605037:0:26060:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219444.605043:0:26060:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219444.605047:0:26060:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d23c.sanity-pfl, flags=17 00000080:00200000:0.0:1721219444.605049:0:26060:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219444.605053:0:26060:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f23c.sanity-pfl, flags=769 00000080:00200000:0.0:1721219444.605055:0:26060:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), inode mode 41ed mask 3 00000080:00200000:0.0:1721219444.605058:0:26060:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), file ffff8800b3ede600, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1721219444.605063:0:26060:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), intent=open|creat 00000002:00010000:0.0:1721219444.605072:0:26060:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23c.sanity-pfl,[0x200000401:0x6a20:0x0]) in obj [0x200000401:0x6a1f:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1721219444.605078:0:26060:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.605102:0:26060:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 1/0,0 mode: --/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.605108:0:26060:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219444.605109:0:26060:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031680/0xe0b47d8ca5f72bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001f03 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.605125:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.605130:0:26060:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219444.605142:0:26060:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219444.605147:0:26060:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9287200 x1804827511277696/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219444.605153:0:26060:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219444.605163:0:26060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277696:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219444.605236:0:26060:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0d80 going to sleep for 80 seconds 00000100:00100000:0.0:1721219444.606684:0:26060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277696:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219444.606693:0:26060:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606703:0:26060:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606709:0:26060:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606714:0:26060:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606719:0:26060:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606726:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606740:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606745:0:26060:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219444.606752:0:26060:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a9287200 x1804827511277696/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219525 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1721219444.606761:0:26060:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9287200 x1804827511277696/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219525 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219444.606768:0:26060:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606774:0:26060:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 16 res 8589935617/27168 (0 0) 00000080:00200000:0.0:1721219444.606781:0:26060:0:(namei.c:1405:ll_create_it()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x6a1f:0x0](ffff8800b06180d8), intent=open|creat 00000080:00200000:0.0:1721219444.606791:0:26060:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a20:0x0](ffff8800b061f518) 00000080:00200000:0.0:1721219444.606794:0:26060:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a20:0x0], updating i_size 0 00000080:00200000:0.0:1721219444.606815:0:26060:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x6a20:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1721219444.606819:0:26060:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x6a20:0x0](ffff8800b061f518) 00000080:00010000:0.0:1721219444.606821:0:26060:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a20:0x0](ffff8800b061f518) for lock 0xe0b47d8ca5f72c0b 00000080:00200000:0.0:1721219444.606828:0:26060:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x6a20:0x0](ffff8800b061f518), flags 120501 00000002:00100000:0.0:1721219444.606836:0:26060:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9287200 x1804827511277696/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219525 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1721219444.606866:0:26060:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72c0b from it ffff8800a9240a80 00010000:00010000:0.0:1721219444.606869:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606883:0:26060:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219444.606893:0:26060:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a20:0x0](ffff8800b061f518), inode mode 81a4 mask 40 00000080:00200000:0.0:1721219444.606923:0:26060:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a20:0x0](ffff8800b061f518), inode mode 81a4 mask 2 00000080:00200000:0.0:1721219444.606930:0:26060:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x6a20:0x0](ffff8800b061f518), xattr lov 00000002:00010000:0.0:1721219444.606937:0:26060:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x6a20:0x0]) in obj [0x200000401:0x6a1f:0x0], intent: open flags 040000002 00010000:00010000:0.0:1721219444.606955:0:26060:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219444.606961:0:26060:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219444.606969:0:26060:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219444.606973:0:26060:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9280e40 x1804827511277824/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219444.606979:0:26060:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219444.606989:0:26060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277824:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219444.607035:0:26060:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0d80 going to sleep for 80 seconds 00000100:00100000:3.0:1721219444.607957:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219444.607975:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459619456 00000100:00100000:3.0:1721219444.607997:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181524 00000100:00100000:3.0:1721219444.608001:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8986d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27125:x1804827459619456:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219444.608024:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1721219444.608026:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8986d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27125:x1804827459619456:12345-192.168.201.158@tcp:104: Request processed in 26us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219444.608030:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181524 00010000:00010000:3.0:1721219444.608041:0:11573:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219444.608044:0:11573:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.608049:0:11573:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deef40 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:3.0:1721219444.608050:0:11573:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.608054:0:11573:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.608057:0:11573:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219444.608065:0:11573:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x6a20:0x0]: losing layout lock 00010000:00010000:3.0:1721219444.608076:0:11573:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.608083:0:11573:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219444.608099:0:11573:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.608102:0:11573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72c0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a20:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001f34 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219444.608109:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219444.608110:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219444.608111:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219444.608119:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8981c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511277888:192.168.201.158@tcp:103:ldlm_bl_06.0 00000100:00100000:3.0:1721219444.608867:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8981c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511277888:192.168.201.158@tcp:103:ldlm_bl_06.0 00000100:00100000:1.0:1721219444.858810:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278016:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219444.858816:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511277952:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219444.858870:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278144:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219444.858872:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511278080:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219444.860223:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278016:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219444.860229:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278144:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219444.860230:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511277952:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219444.860251:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511278080:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1721219445.486836:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219446.488875:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219447.490857:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219448.492874:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219449.494837:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219449.866833:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511278208:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219449.866852:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278272:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219449.866908:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278400:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219449.866910:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511278336:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219449.868331:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511278336:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219449.868340:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511278208:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219449.868364:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278272:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219449.868372:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278400:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219450.496867:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219451.498894:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219452.500830:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219453.502793:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219454.504844:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219454.874878:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278528:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219454.874932:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511278464:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219454.874966:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278656:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219454.874973:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511278592:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219454.876939:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278528:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219454.876949:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511278656:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219454.876956:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511278592:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219454.876977:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511278464:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1721219455.506844:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219456.508823:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219457.510907:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219458.512877:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219459.514915:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219459.882870:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511278784:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219459.882909:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8981c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511278720:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219459.882926:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8984c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511278912:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219459.882934:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8980980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511278848:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219459.884195:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511278784:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219459.884198:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8981c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511278720:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219459.884205:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8984c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511278912:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219459.884206:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8980980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511278848:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1721219460.516820:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219461.518883:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219462.520828:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219463.522893:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219464.524851:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219464.609190:0:26060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511277824:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219464.609206:0:26060:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609216:0:26060:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609220:0:26060:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609224:0:26060:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609236:0:26060:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609240:0:26060:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def3c0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219464.609242:0:26060:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609245:0:26060:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609248:0:26060:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609252:0:26060:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219464.609255:0:26060:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219464.609257:0:26060:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72c12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a1f:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 26060 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219464.609283:0:26060:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a9280e40 x1804827511277824/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/600 e 0 to 0 dl 1721219525 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1721219464.609296:0:26060:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1721219464.609384:0:26060:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x6a20:0x0](ffff8800b061f518) 00000002:00100000:0.0:1721219464.609405:0:26060:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9287200 x1804827511277696/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219525 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1721219464.609421:0:26060:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1721219464.609424:0:26060:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9280e40 x1804827511279040/t0(0) o35->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1721219464.609440:0:26060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511279040:192.168.201.158@tcp:35:lfs.0 00000100:00100000:0.0:1721219464.609486:0:26060:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0d80 going to sleep for 6 seconds 00000100:00100000:0.0:1721219464.610436:0:26060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:26060:1804827511279040:192.168.201.158@tcp:35:lfs.0 00000002:00100000:0.0:1721219464.610447:0:26060:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9287200 x1804827511277696/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219525 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000100:00100000:2.0:1721219464.890753:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8981c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511279168:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219464.890759:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8980980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511279104:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219464.890806:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8984c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511279232:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219464.890811:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511279296:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219464.891856:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8980980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511279104:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219464.891857:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511279296:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1721219464.891865:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8984c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511279232:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1721219464.891871:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8981c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511279168:192.168.201.158@tcp:400:kworker/u8:1.0 00000400:00000080:1.0:1721219464.960577:0:26207:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219464.960580:0:26207:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_23c: @@@@@@ FAIL: Create /mnt/lustre/d23c.sanity-pfl/f23c.sanity-pfl failed Debug log: 588 lines, 588 kept, 0 dropped, 0 bad.