00010000:00010000:2.0F:1721219278.152787:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1721219279.154804:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1721219279.594757:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9286880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258304:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219279.594779:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511258240:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219279.594819:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258432:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219279.594820:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511258368:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219279.595800:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258432:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219279.595814:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9286880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258304:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219279.595817:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511258240:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219279.595827:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511258368:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:3.0F:1721219280.156800:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:2.0:1721219280.333233:0:21073:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1721219280.333239:0:21073:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22b: Test simple 'out of space' condition with repeat ========================================================== 08:27:59 (1721219279) 00000080:00200000:2.0:1721219280.412879:0:20937:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:2.0:1721219280.412895:0:20937:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1721219280.412907:0:20937:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219280.412919:0:20937:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1721219280.412928:0:20937:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:2.0:1721219280.412930:0:20937:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:2.0:1721219280.412936:0:20937:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012c43faf8 00010000:00010000:2.0:1721219280.412938:0:20937:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219280.412945:0:20937:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1721219280.412958:0:20937:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:2.0:1721219280.412965:0:20937:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22b.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1 00000080:00200000:2.0:1721219280.412968:0:20937:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22b.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=getattr 00000002:00010000:2.0:1721219280.412974:0:20937:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22b.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1721219280.413006:0:20937:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219280.413012:0:20937:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219280.413030:0:20937:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219280.413050:0:20937:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20937:1804827511258496:192.168.201.158@tcp:101:bash.0 00000100:00100000:2.0:1721219280.413116:0:20937:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162d80 going to sleep for 90 seconds 00000100:00100000:0.0:1721219280.414613:0:20937:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20937:1804827511258496:192.168.201.158@tcp:101:bash.0 00010000:00010000:0.0:1721219280.414622:0:20937:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414628:0:20937:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414632:0:20937:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414635:0:20937:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414639:0:20937:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414643:0:20937:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9baeac0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219280.414645:0:20937:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414648:0:20937:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414679:0:20937:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414682:0:20937:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219280.414685:0:20937:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414688:0:20937:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9baeac0/0xe0b47d8ca5f72a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219280.414696:0:20937:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a8602ac0 x1804827511258496/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219371 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1721219280.414709:0:20937:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1721219280.414756:0:20937:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219280.414760:0:20937:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219280.414763:0:20937:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1721219280.414775:0:20937:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414778:0:20937:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.414782:0:20937:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219280.414788:0:20937:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9286880 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20937:1804827511258560:192.168.201.158@tcp:101:bash.0 00000100:00100000:0.0:1721219280.414815:0:20937:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0000 going to sleep for 90 seconds 00000100:00100000:0.0:1721219280.416000:0:20937:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9286880 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20937:1804827511258560:192.168.201.158@tcp:101:bash.0 00010000:00010000:0.0:1721219280.416012:0:20937:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416017:0:20937:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416023:0:20937:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416027:0:20937:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416031:0:20937:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416034:0:20937:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416037:0:20937:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219280.416041:0:20937:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a9286880 x1804827511258560/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 576/688 e 0 to 0 dl 1721219371 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:0.0:1721219280.416046:0:20937:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416050:0:20937:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1721219280.416061:0:20937:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:0.0:1721219280.416064:0:20937:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f72a8a 00000080:00010000:0.0:1721219280.416069:0:20937:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219280.416070:0:20937:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72a8a from it ffff88012c43fcf8 00010000:00010000:0.0:1721219280.416071:0:20937:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219280.416074:0:20937:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219280.417962:0:21097:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219280.417969:0:21097:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219280.417973:0:21097:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.417979:0:21097:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219280.417984:0:21097:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219280.417985:0:21097:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219280.417987:0:21097:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8833b58 00010000:00010000:1.0:1721219280.417988:0:21097:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.417992:0:21097:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219280.417997:0:21097:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:1.0:1721219280.418001:0:21097:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22b.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1536 00000080:00200000:1.0:1721219280.418002:0:21097:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219280.418004:0:21097:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219280.418006:0:21097:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.418012:0:21097:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219280.418016:0:21097:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219280.418016:0:21097:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219280.418018:0:21097:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8833bf8 00010000:00010000:1.0:1721219280.418019:0:21097:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.418021:0:21097:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219280.418025:0:21097:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219280.418027:0:21097:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219280.418028:0:21097:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219280.418030:0:21097:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.418033:0:21097:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219280.418035:0:21097:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219280.418036:0:21097:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219280.418037:0:21097:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8833da0 00010000:00010000:1.0:1721219280.418038:0:21097:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.418041:0:21097:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219280.418047:0:21097:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219280.418049:0:21097:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d22b.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8) 00010000:00010000:1.0:1721219280.418063:0:21097:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.418069:0:21097:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.418086:0:21097:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219280.418090:0:21097:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219280.418090:0:21097:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72a8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e0016d6 expref: -99 pid: 20937 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1721219280.418098:0:21097:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1721219280.418102:0:21097:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a862c740 x1804827511258688/t0(0) o36->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1721219280.418110:0:21097:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c740 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:21097:1804827511258688:192.168.201.158@tcp:36:mkdir.0 00000100:00100000:1.0:1721219280.418138:0:21097:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5540 going to sleep for 90 seconds 00000100:00100000:1.0:1721219280.420719:0:21097:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c740 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:21097:1804827511258688:192.168.201.158@tcp:36:mkdir.0 00000080:00200000:1.0:1721219280.420735:0:21097:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a15:0x0](ffff880136eb1fd8) 00000080:00200000:1.0:1721219280.420737:0:21097:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a15:0x0], updating i_size 512 00010000:00010000:2.0:1721219281.158941:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219282.160801:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219283.162886:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219284.164863:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219284.602843:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258816:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219284.602854:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9286880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511258752:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219284.602907:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258944:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219284.602909:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511258880:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219284.604797:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258816:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219284.604804:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258944:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219284.604820:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9286880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511258752:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219284.604828:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511258880:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219285.166846:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219286.168898:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219287.170892:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219288.172898:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219289.174899:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219289.610868:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259072:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219289.610932:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511259008:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219289.610957:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259200:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219289.610983:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511259136:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219289.612858:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259072:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219289.612871:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259200:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219289.612889:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92817c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511259008:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219289.612904:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92804c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511259136:192.168.201.158@tcp:400:kworker/u8:2.0 00000080:00200000:3.0:1721219289.997333:0:21274:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219289.997354:0:21274:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219289.997368:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219289.997381:0:21274:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219289.997390:0:21274:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219289.997392:0:21274:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219289.997399:0:21274:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012cdd3af8 00010000:00010000:3.0:1721219289.997401:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219289.997408:0:21274:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219289.997420:0:21274:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219289.997427:0:21274:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22b.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=16 00000080:00200000:3.0:1721219289.997430:0:21274:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22b.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=0 00000002:00010000:3.0:1721219289.997436:0:21274:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22b.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219289.997470:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219289.997476:0:21274:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219289.997484:0:21274:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219289.997511:0:21274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8986d40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259264:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219289.997590:0:21274:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940f00 going to sleep for 90 seconds 00000100:00100000:0.0:1721219290.000316:0:21274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8986d40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259264:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219290.000330:0:21274:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000342:0:21274:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000357:0:21274:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000365:0:21274:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000372:0:21274:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000378:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000383:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000387:0:21274:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219290.000394:0:21274:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a8986d40 x1804827511259264/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219380 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219290.000403:0:21274:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000409:0:21274:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589935617/27157 (0 0) 00000080:00200000:0.0:1721219290.000423:0:21274:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a15:0x0], updating i_size 11776 00000080:00200000:0.0:1721219290.000425:0:21274:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6a15:0x0](ffff880136eb1fd8): rc = 0 00000080:00010000:0.0:1721219290.000430:0:21274:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a15:0x0](ffff880136eb1fd8) for lock 0xe0b47d8ca5f72a91 00000080:00010000:0.0:1721219290.000436:0:21274:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x6a15:0x0](ffff880136eb1fd8) 00000080:00010000:0.0:1721219290.000442:0:21274:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72a91 from it ffff88012cdd3a70 00010000:00010000:0.0:1721219290.000444:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000449:0:21274:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f72a91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001700 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219290.000466:0:21274:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219290.000473:0:21274:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f22b.sanity-pfl, dir=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), flags=0 00000080:00200000:0.0:1721219290.000475:0:21274:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22b.sanity-pfl, dir=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), intent=getattr 00000002:00010000:0.0:1721219290.000482:0:21274:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22b.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x6a15:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219290.000500:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000505:0:21274:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.000511:0:21274:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219290.000521:0:21274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282f80 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259328:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219290.000562:0:21274:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0900 going to sleep for 90 seconds 00000100:00100000:0.0:1721219290.002266:0:21274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282f80 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259328:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219290.002277:0:21274:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002285:0:21274:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002301:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002306:0:21274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002311:0:21274:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002316:0:21274:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deef40 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219290.002318:0:21274:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002323:0:21274:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002327:0:21274:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002332:0:21274:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219290.002335:0:21274:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002339:0:21274:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deef40/0xe0b47d8ca5f72a98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219290.002349:0:21274:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a9282f80 x1804827511259328/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219381 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:0.0:1721219290.002373:0:21274:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589935617/27157 (0 0) 00000080:00200000:0.0:1721219290.002410:0:21274:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219290.002416:0:21274:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219290.002421:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002428:0:21274:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219290.002433:0:21274:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219290.002435:0:21274:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219290.002438:0:21274:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012cdd3bb0 00010000:00010000:0.0:1721219290.002440:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002444:0:21274:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219290.002451:0:21274:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219290.002454:0:21274:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d22b.sanity-pfl, flags=17 00000080:00200000:0.0:1721219290.002456:0:21274:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219290.002462:0:21274:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), inode mode 41ed mask 3 00000080:00200000:0.0:1721219290.002464:0:21274:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f22b.sanity-pfl, dir=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), file ffff88012d8dde00, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1721219290.002469:0:21274:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22b.sanity-pfl, dir=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), intent=open|creat 00000002:00010000:0.0:1721219290.002479:0:21274:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22b.sanity-pfl,[0x200000401:0x6a16:0x0]) in obj [0x200000401:0x6a15:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1721219290.002500:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.002514:0:21274:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219290.002523:0:21274:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219290.002527:0:21274:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9282f80 x1804827511259456/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219290.002533:0:21274:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219290.002543:0:21274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282f80 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259456:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219290.002675:0:21274:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0900 going to sleep for 90 seconds 00000100:00100000:0.0:1721219290.005088:0:21274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282f80 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259456:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219290.005099:0:21274:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005109:0:21274:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005114:0:21274:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005119:0:21274:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005124:0:21274:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005139:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005143:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005147:0:21274:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219290.005152:0:21274:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a9282f80 x1804827511259456/t12884902026(12884902026) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219381 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1721219290.005161:0:21274:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9282f80 x1804827511259456/t12884902026(12884902026) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219381 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219290.005167:0:21274:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005172:0:21274:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 16 res 8589935617/27158 (0 0) 00000080:00200000:0.0:1721219290.005180:0:21274:0:(namei.c:1405:ll_create_it()) VFS Op:name=f22b.sanity-pfl, dir=[0x200000401:0x6a15:0x0](ffff880136eb1fd8), intent=open|creat 00000080:00200000:0.0:1721219290.005191:0:21274:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a16:0x0](ffff8800b061a798) 00000080:00200000:0.0:1721219290.005194:0:21274:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a16:0x0], updating i_size 0 00000080:00200000:0.0:1721219290.005239:0:21274:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x6a16:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1721219290.005242:0:21274:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x6a16:0x0](ffff8800b061a798) 00000080:00010000:0.0:1721219290.005260:0:21274:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a16:0x0](ffff8800b061a798) for lock 0xe0b47d8ca5f72a9f 00000080:00200000:0.0:1721219290.005267:0:21274:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x6a16:0x0](ffff8800b061a798), flags 120501 00000002:00100000:0.0:1721219290.005276:0:21274:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9282f80 x1804827511259456/t12884902026(12884902026) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219381 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1721219290.005315:0:21274:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72a9f from it ffff8800a9240960 00010000:00010000:0.0:1721219290.005317:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005322:0:21274:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219290.005329:0:21274:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a16:0x0](ffff8800b061a798), inode mode 81a4 mask 40 00000080:00200000:0.0:1721219290.005365:0:21274:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a16:0x0](ffff8800b061a798), inode mode 81a4 mask 2 00000080:00200000:0.0:1721219290.005370:0:21274:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x6a16:0x0](ffff8800b061a798), xattr lov 00000002:00010000:0.0:1721219290.005377:0:21274:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x6a16:0x0]) in obj [0x200000401:0x6a15:0x0], intent: open flags 040000002 00010000:00010000:0.0:1721219290.005396:0:21274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.005401:0:21274:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219290.005406:0:21274:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219290.005409:0:21274:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9285a40 x1804827511259584/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219290.005414:0:21274:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219290.005422:0:21274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259584:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219290.005474:0:21274:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce00c0 going to sleep for 90 seconds 00000100:00100000:2.0:1721219290.006945:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219290.007044:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459574400 00000100:00100000:3.0:1721219290.007087:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181499 00000100:00100000:3.0:1721219290.007092:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8606880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27125:x1804827459574400:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219290.007133:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1721219290.007137:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8606880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27125:x1804827459574400:12345-192.168.201.158@tcp:104: Request processed in 46us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219290.007144:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181499 00010000:00010000:0.0:1721219290.007199:0:9881:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219290.007205:0:9881:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.007218:0:9881:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dee400 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219290.007236:0:9881:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.007241:0:9881:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.007246:0:9881:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219290.007259:0:9881:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x6a16:0x0]: losing layout lock 00010000:00010000:0.0:1721219290.007278:0:9881:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.007282:0:9881:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219290.007304:0:9881:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.007308:0:9881:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dee400/0xe0b47d8ca5f72a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001731 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219290.007318:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219290.007319:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219290.007320:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219290.007326:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721219290.007335:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259648:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1721219290.008505:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259648:192.168.201.158@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1721219290.176888:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219291.178918:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219292.180895:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219293.183013:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219294.184976:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219294.618874:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511259776:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219294.618938:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511259712:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219294.618968:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511259904:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219294.618988:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259840:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219294.621012:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511259904:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219294.621035:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511259776:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219294.621083:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511259712:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219294.621099:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511259840:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219295.186966:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219296.188958:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219297.190902:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219298.192954:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219299.194958:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219299.626909:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260032:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219299.626978:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511259968:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219299.627008:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260160:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219299.627028:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511260096:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219299.629251:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260032:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219299.629264:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260160:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219299.629327:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511259968:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219299.629343:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511260096:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1721219300.196937:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219301.198943:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219302.200897:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219303.202921:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219304.205024:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219304.634846:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260288:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219304.634886:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511260224:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219304.634913:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9283440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260416:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219304.634914:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511260352:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219304.636753:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260288:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219304.636780:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9283440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511260416:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219304.636801:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511260224:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219304.636809:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9281300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511260352:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219305.207019:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219306.209016:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219307.210915:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219308.212842:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219309.214837:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219309.642817:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511260480:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219309.642817:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8603900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511260544:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219309.642874:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8605580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511260672:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219309.642878:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511260608:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219309.644416:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8603900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511260544:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219309.644418:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8601c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511260480:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219309.644427:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511260608:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219309.644428:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8605580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511260672:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219310.009355:0:21274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511259584:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219310.009374:0:21274:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009386:0:21274:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009405:0:21274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009413:0:21274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009421:0:21274:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009427:0:21274:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def600 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219310.009431:0:21274:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009437:0:21274:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009443:0:21274:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009448:0:21274:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219310.009452:0:21274:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219310.009456:0:21274:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a15:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 21274 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219310.009482:0:21274:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a9285a40 x1804827511259584/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/600 e 0 to 0 dl 1721219381 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1721219310.009506:0:21274:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1721219310.009600:0:21274:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x6a16:0x0](ffff8800b061a798) 00000002:00100000:0.0:1721219310.009624:0:21274:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9282f80 x1804827511259456/t12884902026(12884902026) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219381 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1721219310.009644:0:21274:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1721219310.009648:0:21274:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9285a40 x1804827511260800/t0(0) o35->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1721219310.009687:0:21274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511260800:192.168.201.158@tcp:35:lfs.0 00000100:00100000:0.0:1721219310.009738:0:21274:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219310.011114:0:21274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:21274:1804827511260800:192.168.201.158@tcp:35:lfs.0 00000002:00100000:0.0:1721219310.011126:0:21274:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9282f80 x1804827511259456/t12884902026(12884902026) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219381 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:2.0:1721219310.216762:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1721219310.305303:0:21421:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219310.305305:0:21421:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22b: @@@@@@ FAIL: Create /mnt/lustre/d22b.sanity-pfl/f22b.sanity-pfl failed Debug log: 361 lines, 361 kept, 0 dropped, 0 bad.