00010000:00010000:2.0F:1717019025.013000:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019026.014687:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019027.016989:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0F:1717019027.394200:0:27557:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1717019027.394207:0:27557:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 23e: Append with next real comp: spillover and backward extension ========================================================== 17:43:47 (1717019027) 00000080:00200000:0.0F:1717019027.457211:0:27420:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717019027.457233:0:27420:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1717019027.457245:0:27420:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.457253:0:27420:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1717019027.457259:0:27420:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717019027.457260:0:27420:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:0.0:1717019027.457264:0:27420:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a88e3af8 00010000:00010000:0.0:1717019027.457265:0:27420:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.457268:0:27420:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717019027.457277:0:27420:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:0.0:1717019027.457283:0:27420:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1 00000080:00200000:0.0:1717019027.457286:0:27420:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=getattr 00000002:00010000:0.0:1717019027.457289:0:27420:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1717019027.457313:0:27420:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.457316:0:27420:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.457321:0:27420:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019027.457338:0:27420:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:27420:1800422838684928:192.168.203.126@tcp:101:bash.0 00000100:00100000:0.0:1717019027.457424:0:27420:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0840 going to sleep for 80 seconds 00000100:00100000:0.0:1717019027.459612:0:27420:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:27420:1800422838684928:192.168.203.126@tcp:101:bash.0 00010000:00010000:0.0:1717019027.459627:0:27420:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459636:0:27420:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459640:0:27420:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459659:0:27420:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459665:0:27420:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459669:0:27420:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a89386c0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717019027.459672:0:27420:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459677:0:27420:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459681:0:27420:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459686:0:27420:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717019027.459688:0:27420:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459700:0:27420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a89386c0/0xe1aedd3f13a368b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019027.459711:0:27420:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012fa62ac0 x1800422838684928/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019108 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1717019027.459731:0:27420:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1717019027.459822:0:27420:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717019027.459829:0:27420:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1717019027.459833:0:27420:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1717019027.459853:0:27420:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459857:0:27420:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.459861:0:27420:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019027.459871:0:27420:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:27420:1800422838684992:192.168.203.126@tcp:101:bash.0 00000100:00100000:0.0:1717019027.460017:0:27420:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0840 going to sleep for 80 seconds 00000100:00100000:0.0:1717019027.462473:0:27420:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:27420:1800422838684992:192.168.203.126@tcp:101:bash.0 00010000:00010000:0.0:1717019027.462486:0:27420:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462492:0:27420:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462506:0:27420:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462513:0:27420:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462519:0:27420:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462524:0:27420:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462528:0:27420:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019027.462535:0:27420:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012fa62ac0 x1800422838684992/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1717019108 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:0.0:1717019027.462543:0:27420:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462550:0:27420:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1717019027.462569:0:27420:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 14848 00000080:00010000:0.0:1717019027.462572:0:27420:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a368c0 00000080:00010000:0.0:1717019027.462576:0:27420:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717019027.462578:0:27420:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a368c0 from it ffff8800a88e3cf8 00010000:00010000:0.0:1717019027.462579:0:27420:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019027.462612:0:27420:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00000080:00200000:1.0F:1717019027.465903:0:27581:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717019027.465927:0:27581:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717019027.465942:0:27581:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.465956:0:27581:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717019027.465966:0:27581:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717019027.465968:0:27581:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717019027.465974:0:27581:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a92bbb58 00010000:00010000:1.0:1717019027.465976:0:27581:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.465981:0:27581:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019027.465994:0:27581:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717019027.466004:0:27581:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1536 00000080:00200000:1.0:1717019027.466007:0:27581:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717019027.466011:0:27581:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717019027.466015:0:27581:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.466020:0:27581:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717019027.466025:0:27581:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717019027.466027:0:27581:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717019027.466029:0:27581:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a92bbbf8 00010000:00010000:1.0:1717019027.466035:0:27581:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.466040:0:27581:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019027.466047:0:27581:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717019027.466051:0:27581:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717019027.466055:0:27581:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717019027.466058:0:27581:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.466063:0:27581:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717019027.466069:0:27581:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717019027.466071:0:27581:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717019027.466073:0:27581:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a92bbda0 00010000:00010000:1.0:1717019027.466074:0:27581:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.466079:0:27581:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019027.466084:0:27581:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717019027.466088:0:27581:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8) 00010000:00010000:1.0:1717019027.466110:0:27581:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.466121:0:27581:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.466171:0:27581:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019027.466177:0:27581:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717019027.466178:0:27581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8939200/0xe1aedd3f13a368c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1fb6 expref: -99 pid: 27420 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1717019027.466195:0:27581:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1717019027.466206:0:27581:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a93e0000 x1800422838685120/t0(0) o36->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1717019027.466228:0:27581:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0000 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:27581:1800422838685120:192.168.203.126@tcp:36:mkdir.0 00000100:00100000:1.0:1717019027.466317:0:27581:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f0c0 going to sleep for 80 seconds 00000100:00100000:1.0:1717019027.469241:0:27581:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0000 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:27581:1800422838685120:192.168.203.126@tcp:36:mkdir.0 00000080:00200000:1.0:1717019027.469284:0:27581:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cfa:0x0](ffff880136efddd8) 00000080:00200000:1.0:1717019027.469289:0:27581:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cfa:0x0], updating i_size 512 00010000:00010000:3.0:1717019028.023810:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019028.512797:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838685184:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019028.512797:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685248:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019028.512855:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838685312:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019028.512855:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685376:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019028.514686:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685248:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019028.515069:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685376:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019028.515271:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838685184:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019028.515280:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838685312:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:1.0:1717019029.024762:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019030.027162:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019031.030841:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019032.032834:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019033.034813:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019033.521404:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685504:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019033.521461:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685632:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019033.521487:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019033.521491:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838685440:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019033.521502:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685568:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019033.524184:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838685440:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019033.524200:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685568:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019033.524209:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685504:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019033.524215:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685632:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:1.0:1717019034.036781:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019035.039076:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019036.041546:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019037.043949:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019037.523569:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717019037.523665:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717019037.523698:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819935360 00000100:00100000:2.0:1717019037.523726:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819935424 00000100:00100000:2.0:1717019037.523739:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77883 00000100:00100000:2.0:1717019037.523743:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8972140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+4:1449:x1800422819935360:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717019037.523800:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717019037.523804:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8972140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+4:1449:x1800422819935360:12345-192.168.203.126@tcp:104: Request processed in 61us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019037.523810:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77883 00000100:00100000:2.0:1717019037.523821:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77884 00000100:00100000:2.0:1717019037.523824:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8973dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+3:1449:x1800422819935424:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717019037.523851:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1717019037.523855:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8973dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+3:1449:x1800422819935424:12345-192.168.203.126@tcp:104: Request processed in 30us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019037.523859:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77884 00010000:00010000:0.0:1717019037.524174:0:4629:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717019037.524178:0:4629:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a36888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1f00 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524186:0:4629:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d200 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717019037.524188:0:4629:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a36888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1f00 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524194:0:4629:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a36888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1f00 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717019037.524198:0:4629:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a36888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1f00 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019037.524202:0:4629:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717019037.524237:0:4629:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a36888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1f00 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524242:0:4629:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717019037.524254:0:4629:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a36888 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1f00 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524257:0:4629:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a36888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1f00 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524269:0:4629:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717019037.524270:0:4629:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f21d40/0xe1aedd3f13a36881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1ef9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524282:0:4629:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f21d40 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717019037.524283:0:4629:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f21d40/0xe1aedd3f13a36881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1ef9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524287:0:4629:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f21d40/0xe1aedd3f13a36881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1ef9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717019037.524290:0:4629:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f21d40/0xe1aedd3f13a36881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1ef9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019037.524293:0:4629:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717019037.524302:0:4629:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f21d40/0xe1aedd3f13a36881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1ef9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524305:0:4629:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717019037.524309:0:4629:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f21d40/0xe1aedd3f13a36881 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1ef9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019037.524312:0:4629:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f21d40/0xe1aedd3f13a36881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1ef9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019037.524484:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019037.524497:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838685760:192.168.203.126@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1717019037.524533:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1717019037.524537:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838685696:192.168.203.126@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1717019037.526415:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019037.526419:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019037.526421:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019037.528047:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838685696:192.168.203.126@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1717019037.528056:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838685760:192.168.203.126@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1717019038.045629:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019038.531857:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838685824:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019038.531857:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685888:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019038.531912:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838685952:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019038.531912:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838686016:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019038.536487:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838685824:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019038.536493:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838685888:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019038.536499:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838685952:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019038.536504:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838686016:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:2.0:1717019039.047435:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717019039.277679:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717019039.277695:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 131 10000000:01000000:2.0:1717019039.277699:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717019039.277729:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019039.277737:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019039.277744:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019039.277763:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686080:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019039.277828:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a88806c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019039.282578:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686080:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019039.282629:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019039.282637:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019039.282695:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686144:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019039.282743:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0240 going to sleep for 6 seconds 00000100:00100000:0.0:1717019039.285374:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686144:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019039.285438:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686208:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019039.285520:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0240 going to sleep for 6 seconds 00000100:00100000:0.0:1717019039.288837:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686208:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019039.289683:0:27769:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27769:1800422838686272:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717019039.289756:0:27769:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892fb40 going to sleep for 6 seconds 00000100:00100000:1.0:1717019039.293239:0:27769:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27769:1800422838686272:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717019039.293278:0:27769:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717019039.293285:0:27769:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717019039.293286:0:27769:0:(obd_config.c:1460:class_process_config()) marker 86 (0x1) lustre-clilov new lustre.test_23e 00000020:01000000:1.0:1717019039.293291:0:27769:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717019039.293293:0:27769:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1717019039.293309:0:27769:0:(lov_pool.c:313:lov_pool_new()) test_23e is pool #2 00000100:00100000:1.0:1717019039.293336:0:27769:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27769:1800422838686336:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717019039.293395:0:27769:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717019039.297352:0:27769:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27769:1800422838686336:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717019039.297413:0:27769:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27769:1800422838686400:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717019039.297475:0:27769:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717019039.300013:0:27769:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27769:1800422838686400:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717019039.300050:0:27769:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717019039.300056:0:27769:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717019039.300057:0:27769:0:(obd_config.c:1460:class_process_config()) marker 86 (0x2) lustre-clilov new lustre.test_23e 00000040:00080000:1.0:1717019039.300061:0:27769:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 135 count 132 00000020:01000000:0.0:1717019039.300911:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 131-134 (rc=0) 10000000:01000000:0.0:1717019039.300929:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717019039.300935:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019039.300943:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019039.300950:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717019039.300952:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:0.0:1717019039.300954:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717019039.300977:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019039.300982:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019039.300989:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019039.301004:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686464:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717019039.301067:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0240 going to sleep for 6 seconds 00000100:00100000:0.0:1717019039.303239:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686464:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019039.303260:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019039.303269:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019039.303320:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686528:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019039.303386:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0240 going to sleep for 6 seconds 00000100:00100000:0.0:1717019039.306007:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686528:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717019039.306041:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717019039.306047:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019039.306054:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019040.048754:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019040.321444:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717019040.321491:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717019040.321544:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819938816 00000100:00100000:3.0:1717019040.321621:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819938880 00000100:00100000:3.0:1717019040.321639:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77885 00000100:00100000:3.0:1717019040.321645:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a23dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+4:1644:x1800422819938816:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717019040.321716:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717019040.321720:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a23dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+4:1644:x1800422819938816:12345-192.168.203.126@tcp:104: Request processed in 75us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019040.321726:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77885 00000100:00100000:3.0:1717019040.321749:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77886 00000100:00100000:3.0:1717019040.321752:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a26d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+3:1644:x1800422819938880:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717019040.321779:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717019040.321783:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a26d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+3:1644:x1800422819938880:12345-192.168.203.126@tcp:104: Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019040.321787:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77886 00010000:00010000:1.0:1717019040.321907:0:4630:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1717019040.321916:0:4630:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019040.321926:0:4630:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a89386c0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717019040.321928:0:4630:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019040.321947:0:4630:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717019040.321951:0:4630:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717019040.321954:0:4630:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717019040.321966:0:4629:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717019040.321971:0:4629:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019040.321978:0:4629:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809fa80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717019040.321980:0:4629:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019040.321989:0:4629:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019040.322002:0:4630:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717019040.322003:0:4629:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019040.322006:0:4630:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1717019040.322007:0:4629:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717019040.322020:0:4630:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019040.322025:0:4630:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a368ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c203b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019040.322033:0:4629:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019040.322038:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019040.322038:0:4629:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717019040.322039:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019040.322040:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019040.322045:0:4629:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019040.322049:0:4629:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2034 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019040.322054:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838686592:192.168.203.126@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1717019040.322069:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019040.322070:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019040.322071:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019040.322111:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1717019040.322115:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838686656:192.168.203.126@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1717019040.324699:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838686592:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1717019040.326114:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838686656:192.168.203.126@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1717019041.050754:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717019041.874694:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717019041.874700:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 135 10000000:01000000:2.0:1717019041.874704:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717019041.875028:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.875036:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.875043:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019041.875063:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686720:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019041.875474:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 6 seconds 00000100:00100000:2.0:1717019041.877826:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686720:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019041.877855:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.877873:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019041.877948:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686784:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019041.877995:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 6 seconds 00000100:00100000:2.0:1717019041.880017:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686784:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019041.880072:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686848:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019041.880325:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 6 seconds 00000100:00100000:2.0:1717019041.881749:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838686848:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019041.884561:0:27835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27835:1800422838686912:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717019041.884771:0:27835:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f6c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717019041.887879:0:27835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27835:1800422838686912:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717019041.887918:0:27835:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717019041.887925:0:27835:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717019041.887927:0:27835:0:(obd_config.c:1460:class_process_config()) marker 88 (0x1) lustre-clilov add lustre.test_23e.lustre-OST0000_UUID 00000020:01000000:1.0:1717019041.887931:0:27835:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717019041.887933:0:27835:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1717019041.887943:0:27835:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_23e as member 1 00000100:00100000:1.0:1717019041.887973:0:27835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27835:1800422838686976:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717019041.888032:0:27835:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f6c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717019041.890176:0:27835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:27835:1800422838686976:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717019041.890221:0:27835:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717019041.890228:0:27835:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717019041.890230:0:27835:0:(obd_config.c:1460:class_process_config()) marker 88 (0x2) lustre-clilov add lustre.test_23e.lustre-OST0000_UUID 00000040:00080000:1.0:1717019041.890234:0:27835:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 138 count 135 00000020:01000000:2.0:1717019041.890313:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 135-137 (rc=0) 10000000:01000000:2.0:1717019041.890338:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717019041.890345:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.890355:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019041.890363:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717019041.890365:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717019041.890367:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717019041.890392:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.890397:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.890403:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019041.890425:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838687040:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019041.890559:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 6 seconds 00000100:00100000:2.0:1717019041.892236:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838687040:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019041.892254:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.892261:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019041.892307:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838687104:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019041.892356:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 6 seconds 00000100:00100000:2.0:1717019041.893970:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838687104:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1717019041.894003:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1717019041.894009:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019041.894016:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019042.053376:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1717019042.734731:0:27846:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:2.0:1717019042.734746:0:27846:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1717019042.734756:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.734766:0:27846:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1717019042.734780:0:27846:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:2.0:1717019042.734783:0:27846:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:2.0:1717019042.734787:0:27846:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8f57af8 00010000:00010000:2.0:1717019042.734789:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.734794:0:27846:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717019042.734804:0:27846:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:2.0:1717019042.734810:0:27846:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=16 00000080:00200000:2.0:1717019042.734813:0:27846:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=0 00000002:00010000:2.0:1717019042.734818:0:27846:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1717019042.734845:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.734849:0:27846:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.734856:0:27846:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019042.734871:0:27846:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687168:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717019042.734933:0:27846:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 80 seconds 00000100:00100000:2.0:1717019042.737636:0:27846:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687168:192.168.203.126@tcp:101:lfs.0 00010000:00010000:2.0:1717019042.737652:0:27846:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737699:0:27846:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737704:0:27846:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737710:0:27846:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737717:0:27846:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737725:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737730:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737734:0:27846:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717019042.737741:0:27846:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a8973440 x1800422838687168/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019123 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1717019042.737751:0:27846:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737757:0:27846:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589935617/11514 (0 0) 00000080:00200000:2.0:1717019042.737775:0:27846:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cfa:0x0], updating i_size 11776 00000080:00200000:2.0:1717019042.737781:0:27846:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x2cfa:0x0](ffff880136efddd8): rc = 0 00000080:00010000:2.0:1717019042.737787:0:27846:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cfa:0x0](ffff880136efddd8) for lock 0xe1aedd3f13a368e3 00000080:00010000:2.0:1717019042.737795:0:27846:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x2cfa:0x0](ffff880136efddd8) 00000080:00010000:2.0:1717019042.737798:0:27846:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a368e3 from it ffff8800a8f57a70 00010000:00010000:2.0:1717019042.737799:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737805:0:27846:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717019042.737827:0:27846:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfa:0x0](ffff880136efddd8), inode mode 41ed mask 1 00000080:00200000:2.0:1717019042.737835:0:27846:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x2cfa:0x0](ffff880136efddd8), flags=0 00000080:00200000:2.0:1717019042.737838:0:27846:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x2cfa:0x0](ffff880136efddd8), intent=getattr 00000002:00010000:2.0:1717019042.737846:0:27846:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x2cfa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1717019042.737871:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737876:0:27846:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.737882:0:27846:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019042.737897:0:27846:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687232:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717019042.738597:0:27846:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 80 seconds 00000100:00100000:2.0:1717019042.742624:0:27846:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687232:192.168.203.126@tcp:101:lfs.0 00010000:00010000:2.0:1717019042.742640:0:27846:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742661:0:27846:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742666:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742671:0:27846:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742676:0:27846:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742681:0:27846:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d680 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:2.0:1717019042.742683:0:27846:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742688:0:27846:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742692:0:27846:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742696:0:27846:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1717019042.742699:0:27846:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742703:0:27846:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d680/0xe1aedd3f13a368ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717019042.742720:0:27846:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a8973440 x1800422838687232/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019123 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:2.0:1717019042.742744:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742751:0:27846:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1717019042.742757:0:27846:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a368e3 from it ffff8800a8f579f0 00010000:00010000:2.0:1717019042.742759:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742763:0:27846:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717019042.742821:0:27846:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:2.0:1717019042.742829:0:27846:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1717019042.742835:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742839:0:27846:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1717019042.742972:0:27846:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:2.0:1717019042.742974:0:27846:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:2.0:1717019042.742978:0:27846:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8f57bb0 00010000:00010000:2.0:1717019042.742979:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.742989:0:27846:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717019042.742995:0:27846:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:2.0:1717019042.743000:0:27846:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d23e.sanity-pfl, flags=17 00000080:00200000:2.0:1717019042.743002:0:27846:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfa:0x0](ffff880136efddd8), inode mode 41ed mask 1 00000080:00200000:2.0:1717019042.743007:0:27846:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f23e.sanity-pfl, flags=769 00000080:00200000:2.0:1717019042.743009:0:27846:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfa:0x0](ffff880136efddd8), inode mode 41ed mask 3 00000080:00200000:2.0:1717019042.743012:0:27846:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x2cfa:0x0](ffff880136efddd8), file ffff8800b009f800, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1717019042.743018:0:27846:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x2cfa:0x0](ffff880136efddd8), intent=open|creat 00000002:00010000:2.0:1717019042.743028:0:27846:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23e.sanity-pfl,[0x200000401:0x2cfb:0x0]) in obj [0x200000401:0x2cfa:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1717019042.743035:0:27846:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.743066:0:27846:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.743071:0:27846:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717019042.743072:0:27846:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809dd40/0xe1aedd3f13a368e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c20ce expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.743090:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cfa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.743094:0:27846:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1717019042.743102:0:27846:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1717019042.743110:0:27846:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8973440 x1800422838687360/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1717019042.743116:0:27846:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019042.743131:0:27846:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687360:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717019042.743224:0:27846:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 80 seconds 00000100:00100000:2.0:1717019042.746200:0:27846:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687360:192.168.203.126@tcp:101:lfs.0 00010000:00010000:2.0:1717019042.746218:0:27846:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746238:0:27846:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746243:0:27846:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746250:0:27846:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746256:0:27846:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746264:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746269:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746286:0:27846:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717019042.746293:0:27846:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a8973440 x1800422838687360/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019123 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:2.0:1717019042.746301:0:27846:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a8973440 x1800422838687360/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019123 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1717019042.746308:0:27846:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746312:0:27846:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 16 res 8589935617/11515 (0 0) 00000080:00200000:2.0:1717019042.746325:0:27846:0:(namei.c:1405:ll_create_it()) VFS Op:name=f23e.sanity-pfl, dir=[0x200000401:0x2cfa:0x0](ffff880136efddd8), intent=open|creat 00000080:00200000:2.0:1717019042.746337:0:27846:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cfb:0x0](ffff8800b0afce58) 00000080:00200000:2.0:1717019042.746340:0:27846:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cfb:0x0], updating i_size 0 00000080:00200000:2.0:1717019042.746359:0:27846:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x2cfb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1717019042.746362:0:27846:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x2cfb:0x0](ffff8800b0afce58) 00000080:00010000:2.0:1717019042.746364:0:27846:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cfb:0x0](ffff8800b0afce58) for lock 0xe1aedd3f13a368f1 00000080:00200000:2.0:1717019042.746370:0:27846:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x2cfb:0x0](ffff8800b0afce58), flags 120501 00000002:00100000:2.0:1717019042.746377:0:27846:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a8973440 x1800422838687360/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019123 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:2.0:1717019042.746438:0:27846:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a368f1 from it ffff88012b4ce120 00010000:00010000:2.0:1717019042.746441:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746447:0:27846:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717019042.746464:0:27846:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfb:0x0](ffff8800b0afce58), inode mode 81a4 mask 40 00000080:00200000:2.0:1717019042.746522:0:27846:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfb:0x0](ffff8800b0afce58), inode mode 81a4 mask 2 00000080:00200000:2.0:1717019042.746529:0:27846:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x2cfb:0x0](ffff8800b0afce58), xattr lov 00000002:00010000:2.0:1717019042.746553:0:27846:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x2cfb:0x0]) in obj [0x200000401:0x2cfa:0x0], intent: open flags 040000002 00010000:00010000:2.0:1717019042.746617:0:27846:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019042.746623:0:27846:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1717019042.746632:0:27846:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1717019042.746636:0:27846:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8976d40 x1800422838687488/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1717019042.746642:0:27846:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019042.746655:0:27846:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687488:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717019042.746730:0:27846:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880900 going to sleep for 80 seconds 00000100:00100000:3.0:1717019042.748744:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717019042.748832:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819941632 00000100:00100000:2.0:1717019042.748871:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77887 00000100:00100000:2.0:1717019042.748875:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a217c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:12cff408-c572-49fa-81b0-09052c8e7f41+5:8254:x1800422819941632:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717019042.748924:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717019042.748929:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a217c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:12cff408-c572-49fa-81b0-09052c8e7f41+5:8254:x1800422819941632:12345-192.168.203.126@tcp:104: Request processed in 54us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019042.748935:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77887 00010000:00010000:0.0:1717019042.748953:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717019042.748961:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019042.748970:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809eac0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717019042.748973:0:10309:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019042.748977:0:10309:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019042.748982:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717019042.749013:0:10309:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x2cfb:0x0]: losing layout lock 00010000:00010000:0.0:1717019042.749064:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019042.749067:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717019042.749090:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019042.749093:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809eac0/0xe1aedd3f13a368f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c20ff expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019042.749105:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019042.749106:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019042.749107:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019042.749122:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1717019042.749136:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838687552:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1717019042.751132:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838687552:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1717019043.054815:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019043.538519:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687680:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019043.538623:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687808:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019043.538641:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019043.538645:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838687616:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019043.538655:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687744:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019043.540500:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838687616:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019043.540513:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687744:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019043.540521:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687680:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019043.540527:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687808:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:2.0:1717019044.057002:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019045.060150:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019046.060862:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019047.062858:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019048.065136:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019048.547608:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687936:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019048.547671:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688064:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019048.547692:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019048.547696:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838687872:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019048.547707:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688000:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019048.551070:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838687872:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019048.551086:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688000:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019048.551108:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838687936:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019048.551115:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688064:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:3.0:1717019049.066857:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019050.068787:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019051.070839:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019052.073648:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019053.078569:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019053.552824:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688192:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019053.552883:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688320:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019053.552903:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019053.552907:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838688128:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019053.552919:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688256:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019053.556940:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838688128:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019053.556955:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688256:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019053.556964:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688192:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019053.556972:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688320:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1717019054.080982:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019055.082866:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019056.085722:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019057.091657:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019058.092853:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019058.560763:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688448:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019058.560820:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688576:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019058.560837:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019058.560852:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838688384:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019058.560867:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688512:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019058.565395:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688448:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019058.565406:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688576:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019058.565421:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838688384:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019058.565427:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838688512:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1717019059.096856:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019060.098762:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019061.101726:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019062.102749:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019062.753543:0:27846:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838687488:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717019062.753562:0:27846:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753573:0:27846:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753578:0:27846:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753629:0:27846:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753635:0:27846:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753640:0:27846:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d440 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717019062.753642:0:27846:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753647:0:27846:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753651:0:27846:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753656:0:27846:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717019062.753659:0:27846:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019062.753662:0:27846:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d440/0xe1aedd3f13a368f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 27846 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019062.753697:0:27846:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a8976d40 x1800422838687488/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/600 e 0 to 0 dl 1717019123 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1717019062.753711:0:27846:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1717019062.753796:0:27846:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x2cfb:0x0](ffff8800b0afce58) 00000002:00100000:0.0:1717019062.753818:0:27846:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a8973440 x1800422838687360/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019123 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1717019062.753844:0:27846:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1717019062.753848:0:27846:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa62ac0 x1800422838688704/t0(0) o35->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1717019062.753862:0:27846:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838688704:192.168.203.126@tcp:35:lfs.0 00000100:00100000:0.0:1717019062.753920:0:27846:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0180 going to sleep for 6 seconds 00000100:00100000:0.0:1717019062.760222:0:27846:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:27846:1800422838688704:192.168.203.126@tcp:35:lfs.0 00000002:00100000:0.0:1717019062.760245:0:27846:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a8973440 x1800422838687360/t12884902047(12884902047) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019123 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:1.0:1717019063.109446:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1717019063.327246:0:27994:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717019063.327250:0:27994:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_23e: @@@@@@ FAIL: Create /mnt/lustre/d23e.sanity-pfl/f23e.sanity-pfl failed 00000100:00100000:2.0:1717019063.569527:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838688768:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019063.569599:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838688896:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019063.569621:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717019063.569625:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838688832:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019063.569637:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838688960:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019063.575687:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838688768:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019063.575701:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838688896:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019063.575720:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838688832:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019063.575727:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838688960:192.168.203.126@tcp:400:kworker/u8:2.0 Debug log: 593 lines, 593 kept, 0 dropped, 0 bad.