00010000:00010000:3.0F:1747399649.257128:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1747399650.262701:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1747399650.513667:0:17423:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399650.513687:0:17423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399650.513699:0:17423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.513710:0:17423:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399650.513720:0:17423:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399650.513722:0:17423:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399650.513728:0:17423:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880130ddfaf8 00010000:00010000:3.0:1747399650.513730:0:17423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.513735:0:17423:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399650.513748:0:17423:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399650.513755:0:17423:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d1n.ost-pools, flags=16 00000080:00200000:3.0:1747399650.513757:0:17423:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1:0x0](ffff880136f680d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399650.513762:0:17423:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=file, dir=[0x200000401:0x1:0x0](ffff880136f680d8), flags=0 00000080:00200000:3.0:1747399650.513765:0:17423:0:(namei.c:833:ll_lookup_it()) VFS Op:name=file, dir=[0x200000401:0x1:0x0](ffff880136f680d8), intent=getattr 00000002:00010000:3.0:1747399650.513770:0:17423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: file,[0x0:0x0:0x0]) in obj [0x200000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399650.513804:0:17423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.513809:0:17423:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.513817:0:17423:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399650.513839:0:17423:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:17423:1832281081658432:192.168.204.160@tcp:101:rm.0 00000100:00100000:3.0:1747399650.513907:0:17423:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399650.522372:0:17423:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:17423:1832281081658432:192.168.204.160@tcp:101:rm.0 00010000:00010000:3.0:1747399650.522391:0:17423:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522405:0:17423:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522411:0:17423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522417:0:17423:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522423:0:17423:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522428:0:17423:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21200 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399650.522431:0:17423:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522436:0:17423:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522443:0:17423:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522460:0:17423:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399650.522465:0:17423:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522469:0:17423:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdebf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399650.522485:0:17423:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012bf63dc0 x1832281081658432/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747399694 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'rm.0' 00010000:00010000:3.0:1747399650.522516:0:17423:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 30 res 8589935617/1 (0 0) 00000080:00200000:3.0:1747399650.522622:0:17423:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399650.522634:0:17423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399650.522641:0:17423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522651:0:17423:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399650.522657:0:17423:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399650.522659:0:17423:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399650.522664:0:17423:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880130ddfb90 00010000:00010000:3.0:1747399650.522665:0:17423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522670:0:17423:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399650.522682:0:17423:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399650.522694:0:17423:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d1n.ost-pools, flags=16 00000080:00200000:3.0:1747399650.522696:0:17423:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1:0x0](ffff880136f680d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399650.522703:0:17423:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=file, dir=[0x200000401:0x1:0x0](ffff880136f680d8), flags=0 00000080:00200000:3.0:1747399650.522707:0:17423:0:(namei.c:833:ll_lookup_it()) VFS Op:name=file, dir=[0x200000401:0x1:0x0](ffff880136f680d8), intent=getattr 00000002:00010000:3.0:1747399650.522714:0:17423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: file,[0x0:0x0:0x0]) in obj [0x200000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399650.522747:0:17423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522752:0:17423:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399650.522759:0:17423:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399650.522777:0:17423:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:17423:1832281081658496:192.168.204.160@tcp:101:rm.0 00000100:00100000:3.0:1747399650.529771:0:17423:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399650.548614:0:17423:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:17423:1832281081658496:192.168.204.160@tcp:101:rm.0 00010000:00010000:2.0:1747399650.548633:0:17423:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548645:0:17423:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548650:0:17423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548654:0:17423:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548659:0:17423:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548663:0:17423:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21440 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399650.548666:0:17423:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548670:0:17423:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548674:0:17423:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548679:0:17423:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399650.548682:0:17423:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399650.548697:0:17423:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdebff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17423 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399650.548710:0:17423:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012bf63dc0 x1832281081658496/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747399694 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'rm.0' 00010000:00010000:2.0:1747399650.548745:0:17423:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 30 res 8589935617/1 (0 0) 00010000:00010000:2.0:1747399651.263692:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399652.270367:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1747399652.305281:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399652.305375:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399652.305420:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089041536 00000100:00100000:0.0:1747399652.305453:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089041600 00000100:00100000:0.0:1747399652.305462:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 22 00000100:00100000:0.0:1747399652.305467:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:20330:x1832281089041536:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399652.305481:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399652.306150:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399652.306156:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:20330:x1832281089041536:12345-192.168.204.160@tcp:104: Request processed in 689us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399652.306163:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 22 00000100:00100000:0.0:1747399652.306180:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 23 00000100:00100000:0.0:1747399652.306184:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:20330:x1832281089041600:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399652.306189:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399652.306242:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399652.306246:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:20330:x1832281089041600:12345-192.168.204.160@tcp:104: Request processed in 63us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399652.306251:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 23 00010000:00010000:3.0:1747399652.306423:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399652.306573:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399652.306580:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459680 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399652.306583:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399652.306589:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399652.306593:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399652.306609:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399652.306651:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399652.306655:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399652.306802:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399652.306806:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399652.306811:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459440 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399652.306813:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399652.306817:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399652.306820:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399652.306825:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399652.306846:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399652.306849:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399652.306905:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399652.306910:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b459680/0xd95e55596abdebb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604315 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399652.306939:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399652.306940:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399652.306941:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399652.306955:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081658624:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399652.307001:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399652.307005:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081658560:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399652.307194:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399652.307272:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b459440/0xd95e55596abdebb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60430e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399652.307366:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399652.307368:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399652.307370:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399652.315360:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081658560:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399652.315371:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081658624:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00080000:0.0:1747399653.228911:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399653.228924:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747399653.228926:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399653.228928:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0F:1747399653.229004:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081658688:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399653.229413:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081658752:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1747399653.234641:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081658688:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1747399653.243540:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081658752:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399653.269270:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399654.182719:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399654.182728:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 73 10000000:01000000:1.0:1747399654.182735:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399654.182784:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399654.182798:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399654.182809:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399654.182836:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081658816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399654.182958:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:1.0:1747399654.193827:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081658816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399654.193864:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399654.193876:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399654.193970:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081658880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399654.194076:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:1.0:1747399654.206948:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081658880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399654.207030:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081658944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399654.207223:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:1.0:1747399654.211511:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081658944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399654.213031:0:17469:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17469:1832281081659008:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399654.213205:0:17469:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:1.0:1747399654.216555:0:17469:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17469:1832281081659008:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399654.216606:0:17469:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399654.216616:0:17469:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399654.216618:0:17469:0:(obd_config.c:1460:class_process_config()) marker 49 (0x1) lustre-clilov rem lustre.testpool1234567.lustre-OST0000_UUID 00000020:01000000:1.0:1747399654.216623:0:17469:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399654.216625:0:17469:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1747399654.216637:0:17469:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool1234567 00000100:00100000:1.0:1747399654.216670:0:17469:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17469:1832281081659072:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399654.216742:0:17469:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:1.0:1747399654.220643:0:17469:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17469:1832281081659072:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399654.220694:0:17469:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399654.220703:0:17469:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399654.220705:0:17469:0:(obd_config.c:1460:class_process_config()) marker 49 (0x2) lustre-clilov rem lustre.testpool1234567.lustre-OST0000_UUID 00000040:00080000:1.0:1747399654.220708:0:17469:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 76 count 75 00000020:01000000:2.0:1747399654.220924:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 73-75 (rc=0) 10000000:01000000:2.0:1747399654.220946:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399654.220954:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399654.220966:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399654.220975:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399654.220977:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399654.220980:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399654.221010:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399654.221016:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399654.221023:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399654.221043:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399654.221100:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dc00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399654.223011:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399654.223036:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399654.223059:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399654.223123:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659200:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399654.223179:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dc00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399654.225924:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659200:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399654.225970:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399654.225978:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399654.225989:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399654.270285:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399655.271583:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399655.614697:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399655.614751:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399655.614804:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089044352 00000100:00100000:1.0:1747399655.616046:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089044416 00000100:00100000:1.0:1747399655.616068:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 24 00000100:00100000:1.0:1747399655.616074:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:20489:x1832281089044352:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399655.616089:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399655.616187:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399655.616192:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:20489:x1832281089044352:12345-192.168.204.160@tcp:104: Request processed in 118us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399655.616199:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 24 00000100:00100000:1.0:1747399655.616214:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 25 00000100:00100000:1.0:1747399655.616218:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:20489:x1832281089044416:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399655.616224:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399655.616256:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399655.616260:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:20489:x1832281089044416:12345-192.168.204.160@tcp:104: Request processed in 42us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399655.616265:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 25 00010000:00010000:2.0:1747399655.616698:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399655.616704:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616711:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399655.616714:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616720:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399655.616725:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399655.616730:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399655.616771:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616776:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399655.616791:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616797:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdec0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616812:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399655.616813:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616818:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399655.616819:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616823:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399655.616828:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399655.616831:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399655.616840:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616844:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399655.616847:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616851:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399655.616864:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399655.616866:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399655.616867:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399655.616910:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081659264:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399655.616959:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399655.616964:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081659328:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399655.617145:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399655.623388:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081659328:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399655.623402:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081659264:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399656.273591:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399657.138974:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399657.138981:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 76 10000000:01000000:2.0:1747399657.138986:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399657.139034:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.139057:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.139067:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399657.139091:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399657.139299:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399657.142472:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399657.142501:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.142522:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399657.142598:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659456:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399657.145353:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399657.149925:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659456:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399657.149993:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659520:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399657.151033:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399657.161535:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659520:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399657.162138:0:17490:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17490:1832281081659584:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399657.162245:0:17490:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399657.173272:0:17490:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17490:1832281081659584:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399657.173354:0:17490:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399657.173364:0:17490:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399657.173365:0:17490:0:(obd_config.c:1460:class_process_config()) marker 51 (0x1) lustre-clilov del lustre.testpool1234567 00000020:01000000:3.0:1747399657.173372:0:17490:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399657.173374:0:17490:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399657.173453:0:17490:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17490:1832281081659648:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399657.173536:0:17490:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b240 going to sleep for 6 seconds 00000100:00100000:3.0:1747399657.178505:0:17490:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:17490:1832281081659648:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399657.178552:0:17490:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399657.178560:0:17490:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399657.178563:0:17490:0:(obd_config.c:1460:class_process_config()) marker 51 (0x2) lustre-clilov del lustre.testpool1234567 00000040:00080000:3.0:1747399657.178567:0:17490:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 79 count 78 00000020:01000000:2.0:1747399657.178755:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 76-78 (rc=0) 10000000:01000000:2.0:1747399657.178776:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399657.178784:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.178794:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399657.178804:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399657.178806:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399657.178809:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399657.178838:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.178853:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.178860:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399657.178888:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399657.178950:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399657.180741:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399657.180761:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.180770:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399657.180829:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659776:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399657.180916:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399657.183358:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081659776:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399657.183402:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399657.183410:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.183419:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399657.276050:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1747399658.235534:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399658.235541:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747399658.235543:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399658.235546:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747399658.235586:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081659904:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399658.235672:0:1862:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1747399658.235677:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081659840:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399658.239269:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081659840:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399658.247384:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081659904:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:0.0:1747399658.278455:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399659.279660:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399660.289031:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399661.291451:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399662.306833:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399663.034533:0:17781:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399663.034536:0:17781:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 2a: pool_add: non-existant pool testpool ========================================================== 08:47:42 (1747399662) 00000100:00080000:0.0:1747399663.243413:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399663.243417:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747399663.243418:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399663.243420:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399663.243438:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081659968:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399663.243439:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081660032:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399663.248000:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081659968:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399663.248380:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081660032:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399663.308023:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399664.309475:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399665.311857:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399666.315061:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399667.318386:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399668.232109:0:18427:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399668.232114:0:18427:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 2b: pool_add: Invalid pool name ======== 08:47:47 (1747399667) 00000100:00080000:2.0:1747399668.251405:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399668.251413:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399668.251415:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399668.251417:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399668.251435:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660096:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399668.251493:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399668.251496:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081660160:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399668.258965:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081660160:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399668.258976:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660096:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:1.0:1747399668.320549:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399669.321760:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399670.324663:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399671.329238:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399672.332439:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:2.0:1747399672.797192:0:19059:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1747399672.797196:0:19059:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 2c: pool_add: OST index combinations === 08:47:51 (1747399671) 00000100:00080000:2.0:1747399673.259456:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399673.259460:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399673.259461:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399673.259463:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399673.259486:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081660288:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399673.259569:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399673.259574:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081660224:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399673.263443:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081660288:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399673.263936:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081660224:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:1.0:1747399673.333590:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399673.607511:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399673.607590:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399673.607637:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1747399673.607653:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089049792 00000100:00100000:0.0:1747399673.607679:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089049856 00000100:00100000:0.0:1747399673.607687:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 26 00000100:00100000:0.0:1747399673.607692:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:21770:x1832281089049792:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399673.607703:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399673.607765:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399673.607770:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:21770:x1832281089049792:12345-192.168.204.160@tcp:104: Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399673.607777:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 26 00000100:00100000:0.0:1747399673.607788:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 27 00000100:00100000:0.0:1747399673.607792:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:21770:x1832281089049856:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399673.607796:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399673.607830:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399673.607834:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:21770:x1832281089049856:12345-192.168.204.160@tcp:104: Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399673.607839:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 27 00010000:00010000:3.0:1747399673.608004:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399673.608008:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608014:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6400 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399673.608017:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608025:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399673.608039:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399673.608043:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399673.608067:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608071:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399673.608083:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608088:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdec1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608113:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399673.608115:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608118:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f61c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399673.608120:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608124:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399673.608142:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399673.608145:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399673.608152:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608162:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399673.608166:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608169:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdec14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6044f1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399673.608177:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399673.608178:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399673.608179:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399673.608189:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660352:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399673.608220:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399673.608223:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660416:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399673.608328:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399673.611407:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660352:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399673.611425:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660416:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399674.336939:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399675.145095:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399675.145100:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 79 10000000:01000000:0.0:1747399675.145104:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399675.145139:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399675.145149:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399675.145173:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399675.145190:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660480:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399675.145835:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399675.152954:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660480:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399675.152972:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399675.152982:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399675.153034:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660544:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399675.153082:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399675.157228:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660544:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399675.157276:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660608:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399675.157386:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399675.164759:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660608:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399675.165923:0:19092:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19092:1832281081660672:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399675.165997:0:19092:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbe40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399675.175434:0:19092:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19092:1832281081660672:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399675.175472:0:19092:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399675.175480:0:19092:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399675.175482:0:19092:0:(obd_config.c:1460:class_process_config()) marker 53 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:1.0:1747399675.175487:0:19092:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399675.175489:0:19092:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1747399675.175515:0:19092:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:1.0:1747399675.175543:0:19092:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19092:1832281081660736:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399675.175616:0:19092:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:1.0:1747399675.177466:0:19092:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19092:1832281081660736:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399675.177513:0:19092:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399675.177517:0:19092:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399675.177518:0:19092:0:(obd_config.c:1460:class_process_config()) marker 53 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:1.0:1747399675.177522:0:19092:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 82 count 81 00000020:01000000:2.0:1747399675.177659:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 79-81 (rc=0) 10000000:01000000:2.0:1747399675.177676:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399675.177681:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399675.177690:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399675.177697:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399675.177705:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399675.177707:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399675.177731:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399675.177737:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399675.177742:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399675.177755:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660800:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399675.177795:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399675.183109:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660800:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399675.183131:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399675.183139:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399675.183196:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660864:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399675.183248:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399675.189271:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081660864:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399675.189332:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399675.189339:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399675.189348:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399675.339497:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399676.342987:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399677.045849:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399677.045900:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399677.045930:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089052416 00000100:00100000:0.0:1747399677.045955:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089052480 00000100:00100000:0.0:1747399677.045962:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 28 00000100:00100000:0.0:1747399677.045967:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:21956:x1832281089052416:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399677.045978:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399677.046038:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399677.046042:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:21956:x1832281089052416:12345-192.168.204.160@tcp:104: Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399677.046048:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 28 00000100:00100000:0.0:1747399677.046059:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 29 00000100:00100000:0.0:1747399677.046062:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:21956:x1832281089052480:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399677.046067:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399677.046068:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399677.046073:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399677.046080:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399677.046083:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399677.046089:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399677.046093:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399677.046094:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1747399677.046097:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747399677.046097:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:21956:x1832281089052480:12345-192.168.204.160@tcp:104: Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399677.046111:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 29 00010000:00010000:2.0:1747399677.046123:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399677.046127:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399677.046129:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399677.046133:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399677.046140:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f0d80 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:2.0:1747399677.046140:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399677.046141:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399677.046144:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60456f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399677.046146:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399677.046156:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399677.046157:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1747399677.046158:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399677.046159:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399677.046161:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399677.046175:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399677.046180:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1747399677.046183:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660928:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399677.046184:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399677.046188:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f0d80/0xd95e55596abdec22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604568 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399677.046202:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399677.046203:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399677.046205:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399677.046219:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081660992:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399677.055489:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081660992:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399677.055549:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081660928:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399677.343999:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399678.197785:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399678.197791:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 82 10000000:01000000:2.0:1747399678.197795:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399678.197831:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.197839:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.197847:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399678.197864:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661056:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399678.197929:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399678.221498:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661056:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399678.221520:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.221529:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399678.221592:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661120:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399678.222206:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399678.246758:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661120:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399678.246809:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661184:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399678.246890:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399678.257133:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661184:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399678.257271:0:19138:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19138:1832281081661248:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399678.257333:0:19138:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399678.265942:0:19138:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19138:1832281081661248:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:2.0:1747399678.265976:0:19138:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1747399678.265985:0:19138:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1747399678.265986:0:19138:0:(obd_config.c:1460:class_process_config()) marker 55 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:2.0:1747399678.265991:0:19138:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:2.0:1747399678.265993:0:19138:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1747399678.266002:0:19138:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:2.0:1747399678.266027:0:19138:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19138:1832281081661312:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:2.0:1747399678.266089:0:19138:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00080000:2.0:1747399678.267403:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399678.267407:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399678.267409:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399678.267411:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399678.267430:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399678.267442:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081661376:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399678.279100:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081661376:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399678.279135:0:19138:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19138:1832281081661312:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:2.0:1747399678.279160:0:19138:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1747399678.279166:0:19138:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1747399678.279168:0:19138:0:(obd_config.c:1460:class_process_config()) marker 55 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:2.0:1747399678.279171:0:19138:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 85 count 84 00000020:01000000:3.0:1747399678.279965:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 82-84 (rc=0) 10000000:01000000:3.0:1747399678.279984:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1747399678.279990:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.280010:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399678.280017:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1747399678.280019:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:3.0:1747399678.280021:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1747399678.280043:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.280047:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.280054:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399678.280069:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661440:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399678.280130:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399678.282734:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661440:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399678.282762:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.282770:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399678.282826:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661504:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399678.282875:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399678.285561:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661504:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399678.285591:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399678.285597:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.285605:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.345479:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399678.657782:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399678.660120:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089054976 00000100:00100000:1.0:1747399678.660167:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 30 00000100:00100000:1.0:1747399678.660172:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22030:x1832281089054976:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399678.660183:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399678.660253:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399678.660257:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22030:x1832281089054976:12345-192.168.204.160@tcp:104: Request processed in 86us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399678.660263:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 30 00000100:00100000:0.0:1747399678.660825:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399678.660881:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089055040 00000100:00100000:1.0:1747399678.660933:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 31 00000100:00100000:1.0:1747399678.660936:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22030:x1832281089055040:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399678.660950:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399678.661241:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399678.661246:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22030:x1832281089055040:12345-192.168.204.160@tcp:104: Request processed in 309us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399678.661252:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 31 00010000:00010000:2.0:1747399678.661923:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399678.661927:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.661934:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21680 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399678.661937:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.661940:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399678.661943:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.661943:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.661948:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399678.661948:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399678.661950:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.661954:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399678.661958:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399678.661958:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1747399678.661969:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399678.661999:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.662003:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399678.662017:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399678.662021:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdec37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604648 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.662167:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.662173:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399678.662178:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.662182:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdec30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604641 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399678.662196:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399678.662197:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399678.662199:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399678.662210:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081661632:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399678.662252:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1747399678.662255:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399678.662256:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399678.662257:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081661568:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399678.662257:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399678.665804:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081661568:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399678.665815:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081661632:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399679.347626:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399680.035464:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399680.035472:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 85 10000000:01000000:0.0:1747399680.035478:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399680.035524:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399680.035533:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399680.035543:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399680.035569:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661696:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399680.035658:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753f00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399680.040838:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661696:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399680.040866:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399680.040878:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399680.040961:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661760:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399680.041046:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399680.042670:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661760:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399680.042721:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661824:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399680.042787:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399680.047238:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081661824:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399680.048367:0:19147:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19147:1832281081661888:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399680.048459:0:19147:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399680.054008:0:19147:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19147:1832281081661888:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399680.054065:0:19147:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399680.054076:0:19147:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399680.054077:0:19147:0:(obd_config.c:1460:class_process_config()) marker 57 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:1.0:1747399680.054083:0:19147:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399680.054086:0:19147:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1747399680.054097:0:19147:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:1.0:1747399680.054135:0:19147:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19147:1832281081661952:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399680.054213:0:19147:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399680.064235:0:19147:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19147:1832281081661952:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399680.064286:0:19147:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399680.064293:0:19147:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399680.064295:0:19147:0:(obd_config.c:1460:class_process_config()) marker 57 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:1.0:1747399680.064298:0:19147:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 88 count 87 00000020:01000000:2.0:1747399680.064933:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 85-87 (rc=0) 10000000:01000000:2.0:1747399680.064955:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399680.064962:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399680.064973:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399680.064980:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399680.064983:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399680.064985:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399680.065012:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399680.065016:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399680.065023:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399680.065041:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662016:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399680.065106:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399680.071380:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662016:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399680.071409:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399680.071430:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399680.071521:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662080:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399680.071586:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399680.082093:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662080:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399680.082146:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399680.082154:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399680.082165:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399680.350597:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399681.351538:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399681.397188:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399681.399732:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399681.399821:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089057792 00000100:00100000:1.0:1747399681.399868:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 32 00000100:00100000:1.0:1747399681.399873:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22122:x1832281089057792:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399681.399894:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399681.399962:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399681.399967:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22122:x1832281089057792:12345-192.168.204.160@tcp:104: Request processed in 94us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399681.399972:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 32 00010000:00010000:2.0:1747399681.399993:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399681.399999:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.400006:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399681.400010:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.400016:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399681.400021:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399681.400025:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747399681.400595:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089057856 00000100:00100000:0.0:1747399681.400613:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 33 00000100:00100000:0.0:1747399681.400616:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22122:x1832281089057856:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399681.400622:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401436:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401457:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399681.401473:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399681.401616:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081662144:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399681.401694:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdec45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046bf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401712:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399681.401714:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401719:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f0fc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399681.401721:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401727:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399681.401731:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399681.401735:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399681.401750:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401755:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399681.401762:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401765:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046b8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399681.401786:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399681.401787:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399681.401876:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1747399681.401883:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22122:x1832281089057856:12345-192.168.204.160@tcp:104: Request processed in 1266us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399681.401897:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 33 00000100:00100000:3.0:1747399681.402244:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399681.402253:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081662208:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399681.402340:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399681.403557:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399681.405004:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081662144:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399681.407823:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081662208:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399682.355231:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399682.588464:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399682.588469:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 88 10000000:01000000:3.0:1747399682.588475:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399682.588513:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399682.588522:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399682.588529:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399682.588551:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662272:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399682.588773:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399682.595473:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662272:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399682.595501:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399682.595512:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399682.595592:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662336:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399682.595658:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399682.600379:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662336:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399682.600833:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662400:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399682.600925:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399682.604169:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662400:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399682.605106:0:19163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19163:1832281081662464:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399682.605288:0:19163:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399682.615364:0:19163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19163:1832281081662464:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399682.615447:0:19163:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399682.615456:0:19163:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399682.615458:0:19163:0:(obd_config.c:1460:class_process_config()) marker 59 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399682.615464:0:19163:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399682.615467:0:19163:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399682.615478:0:19163:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399682.615512:0:19163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19163:1832281081662528:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399682.615576:0:19163:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399682.620687:0:19163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19163:1832281081662528:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399682.620733:0:19163:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399682.620742:0:19163:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399682.620744:0:19163:0:(obd_config.c:1460:class_process_config()) marker 59 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399682.620748:0:19163:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 91 count 90 00000020:01000000:0.0:1747399682.620907:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 88-90 (rc=0) 10000000:01000000:0.0:1747399682.620927:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399682.620934:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399682.620944:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399682.620952:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399682.620955:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399682.620975:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399682.621002:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399682.621007:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399682.621014:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399682.621030:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662592:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399682.621082:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753b40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399682.624200:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662592:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399682.624235:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399682.624247:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399682.624343:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662656:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399682.624423:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399682.627387:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662656:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399682.627435:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399682.627442:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399682.627453:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399683.275808:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399683.275814:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399683.275816:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399683.275818:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399683.275865:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081662784:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399683.275964:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399683.275969:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081662720:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399683.278938:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081662720:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399683.281041:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081662784:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399683.355604:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399683.993428:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399683.994550:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399683.995290:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399683.995330:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089061504 00000100:00100000:1.0:1747399683.995383:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 34 00000100:00100000:1.0:1747399683.995389:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22198:x1832281089061504:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399683.995404:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399683.995464:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399683.995468:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22198:x1832281089061504:12345-192.168.204.160@tcp:104: Request processed in 79us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399683.995474:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 34 00010000:00010000:0.0:1747399683.995766:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1747399683.995771:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399683.995791:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f0fc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:0.0:1747399683.995795:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399683.995801:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1747399683.995806:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399683.995809:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399683.995859:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399683.995863:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1747399683.995880:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399683.995884:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399683.995900:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399683.995901:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399683.995902:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399683.995918:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081662848:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399683.996066:0:4657:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089061568 00000100:00100000:2.0:1747399683.996096:0:4657:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 2 00000100:00100000:2.0:1747399683.996099:0:4657:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:22198:x1832281089061568:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399683.996104:0:4657:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399683.996127:0:4657:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1747399683.996130:0:4657:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:22198:x1832281089061568:12345-192.168.204.160@tcp:104: Request processed in 31us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1747399683.996134:0:4657:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 2 00010000:00010000:2.0:1747399683.996143:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399683.996146:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399683.996150:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b218c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399683.996152:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399683.996155:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399683.996167:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399683.996170:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399683.996182:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399683.996185:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399683.996194:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399683.996198:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b218c0/0xd95e55596abdec4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6046cd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399683.996219:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399683.996219:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399683.996220:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399683.996227:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081662912:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399683.998448:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081662912:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1747399683.998499:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081662848:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399684.357820:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399685.190445:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399685.190453:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 91 10000000:01000000:3.0:1747399685.190459:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399685.190508:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399685.190534:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399685.190544:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399685.190570:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662976:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399685.190667:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399685.199647:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081662976:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399685.199670:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399685.199679:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399685.199737:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663040:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399685.199794:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399685.202194:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663040:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399685.202241:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663104:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399685.202353:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399685.207145:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663104:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399685.207497:0:19174:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19174:1832281081663168:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399685.207559:0:19174:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399685.212789:0:19174:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19174:1832281081663168:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399685.212823:0:19174:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399685.212832:0:19174:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399685.212833:0:19174:0:(obd_config.c:1460:class_process_config()) marker 61 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399685.212838:0:19174:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399685.212840:0:19174:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399685.212851:0:19174:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399685.212877:0:19174:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19174:1832281081663232:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399685.212926:0:19174:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399685.217957:0:19174:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19174:1832281081663232:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399685.218022:0:19174:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399685.218033:0:19174:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399685.218035:0:19174:0:(obd_config.c:1460:class_process_config()) marker 61 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399685.218040:0:19174:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 95 count 93 00000020:01000000:0.0:1747399685.218494:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 91-94 (rc=0) 10000000:01000000:0.0:1747399685.218518:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399685.218526:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399685.218549:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399685.218558:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399685.218561:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399685.218563:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399685.218592:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399685.218597:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399685.218605:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399685.218625:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399685.218692:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399685.223938:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399685.223966:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399685.223977:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399685.224056:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663360:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399685.224126:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399685.228171:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663360:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399685.228221:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399685.228229:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399685.228239:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399685.359938:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399686.361855:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399686.564734:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399686.565694:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399686.565745:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089064192 00000100:00100000:0.0:1747399686.565778:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089064512 00000100:00100000:0.0:1747399686.565786:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 35 00000100:00100000:0.0:1747399686.565792:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22291:x1832281089064192:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399686.565806:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399686.568458:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399686.568477:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22291:x1832281089064192:12345-192.168.204.160@tcp:104: Request processed in 2678us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399686.568506:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 35 00000100:00100000:0.0:1747399686.568536:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 36 00000100:00100000:0.0:1747399686.568542:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22291:x1832281089064512:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399686.568556:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.568969:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399686.568975:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.568982:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f0fc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399686.568984:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.568990:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399686.568994:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399686.568998:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399686.569045:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.569050:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399686.569067:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399686.569077:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1747399686.569081:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f0fc0/0xd95e55596abdec61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604783 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.569095:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1747399686.569096:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081663424:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399686.569097:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.569101:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21b00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399686.569102:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.569106:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399686.569110:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399686.569114:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399686.569125:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.569128:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399686.569132:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.569136:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b21b00/0xd95e55596abdec5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604744 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399686.569143:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081663488:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399686.569144:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399686.569145:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399686.569146:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399686.570696:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1747399686.570710:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22291:x1832281089064512:12345-192.168.204.160@tcp:104: Request processed in 2163us (5016us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399686.570720:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 36 00010000:00010000:2.0:1747399686.570792:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399686.571632:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081663488:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399686.571645:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081663424:192.168.204.160@tcp:103:ldlm_bl_02.0 10000000:01000000:3.0:1747399686.773450:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399686.773456:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 95 10000000:01000000:3.0:1747399686.773461:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399686.773508:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399686.773517:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399686.773540:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399686.773565:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663552:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399686.773649:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399686.778832:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663552:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399686.778862:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399686.778874:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399686.778953:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663616:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399686.779025:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399686.786106:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663616:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399686.786174:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663680:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399686.786270:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399686.793548:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663680:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399686.797755:0:19189:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19189:1832281081663744:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399686.797878:0:19189:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399686.802171:0:19189:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19189:1832281081663744:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399686.802225:0:19189:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399686.802245:0:19189:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399686.802247:0:19189:0:(obd_config.c:1460:class_process_config()) marker 63 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399686.802252:0:19189:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399686.802254:0:19189:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399686.802267:0:19189:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399686.802326:0:19189:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19189:1832281081663808:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399686.802406:0:19189:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399686.805628:0:19189:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19189:1832281081663808:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399686.805670:0:19189:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399686.805676:0:19189:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399686.805677:0:19189:0:(obd_config.c:1460:class_process_config()) marker 63 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399686.805682:0:19189:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 98 count 96 00000020:01000000:0.0:1747399686.805893:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 95-97 (rc=0) 10000000:01000000:0.0:1747399686.805918:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399686.805927:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399686.805938:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399686.805946:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399686.805949:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399686.805951:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399686.805988:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399686.805994:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399686.806002:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399686.806032:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399686.806098:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67539c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399686.810377:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399686.810403:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.810413:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399686.810485:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663936:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399686.810549:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399686.819451:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081663936:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399686.819497:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399686.819505:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399686.819515:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399687.363809:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399688.182920:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399688.183085:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089067136 00000100:00100000:1.0:1747399688.183132:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 37 00000100:00100000:1.0:1747399688.183137:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22365:x1832281089067136:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399688.183149:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399688.183207:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399688.183219:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22365:x1832281089067136:12345-192.168.204.160@tcp:104: Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399688.183225:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 37 00000100:00100000:0.0:1747399688.185280:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00010000:00010000:2.0:1747399688.185297:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399688.185306:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.185354:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1200 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399688.185357:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.185365:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399688.185384:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399688.185388:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399688.185448:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.185454:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399688.185475:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.185480:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdec6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604824 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399688.185487:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1747399688.185497:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399688.185498:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399688.185499:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399688.185516:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081664000:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399688.186159:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089067456 00000100:00100000:1.0:1747399688.186189:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 38 00000100:00100000:1.0:1747399688.186193:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22365:x1832281089067456:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399688.186203:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399688.186517:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399688.186522:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22365:x1832281089067456:12345-192.168.204.160@tcp:104: Request processed in 328us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399688.186529:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 38 00010000:00010000:2.0:1747399688.186539:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399688.186545:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.186551:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21d40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399688.186553:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.186559:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399688.186564:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399688.186578:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399688.186612:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.186617:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399688.186627:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.186631:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b21d40/0xd95e55596abdec68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604801 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.186642:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399688.186644:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399688.186645:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399688.186650:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399688.186661:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081664064:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399688.189587:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081664064:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399688.189675:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081664000:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399688.283878:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081664128:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00080000:2.0:1747399688.284340:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399688.284344:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399688.284346:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399688.284348:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399688.284370:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081664192:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399688.294445:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081664192:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399688.295110:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081664128:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399688.366593:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399688.489010:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399688.489015:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 98 10000000:01000000:2.0:1747399688.489019:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399688.489052:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.489060:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.489067:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399688.489085:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664256:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399688.489152:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399688.493772:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664256:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399688.493798:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.493810:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399688.494803:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664320:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399688.495498:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399688.498398:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664320:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399688.498463:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664384:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399688.498542:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399688.502441:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664384:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399688.505164:0:19199:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19199:1832281081664448:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399688.505252:0:19199:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399688.511133:0:19199:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19199:1832281081664448:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399688.511175:0:19199:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399688.511183:0:19199:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399688.511185:0:19199:0:(obd_config.c:1460:class_process_config()) marker 65 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399688.511189:0:19199:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399688.511199:0:19199:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399688.511209:0:19199:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399688.511235:0:19199:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19199:1832281081664512:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399688.511347:0:19199:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399688.514055:0:19199:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19199:1832281081664512:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399688.514098:0:19199:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399688.514106:0:19199:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399688.514108:0:19199:0:(obd_config.c:1460:class_process_config()) marker 65 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399688.514112:0:19199:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 101 count 99 00000020:01000000:2.0:1747399688.514409:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 98-100 (rc=0) 10000000:01000000:2.0:1747399688.514433:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399688.514440:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.514449:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399688.514458:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399688.514461:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399688.514463:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399688.514491:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.514496:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.514503:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399688.514520:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399688.514587:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399688.520983:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399688.521011:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399688.521022:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399688.521101:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399688.521167:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399688.524027:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664640:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399688.524078:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399688.524086:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399688.524096:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.370659:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399689.783522:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399689.783581:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399689.783634:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089070848 00000100:00100000:0.0:1747399689.783667:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089070912 00000100:00100000:0.0:1747399689.783677:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 39 00000100:00100000:0.0:1747399689.783683:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:22439:x1832281089070848:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399689.783698:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399689.783769:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399689.783774:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:22439:x1832281089070848:12345-192.168.204.160@tcp:104: Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399689.783779:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 39 00000100:00100000:0.0:1747399689.783794:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 40 00000100:00100000:0.0:1747399689.783797:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22439:x1832281089070912:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399689.783802:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399689.783838:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399689.783841:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22439:x1832281089070912:12345-192.168.204.160@tcp:104: Request processed in 44us (261us total) trans 0 rc 0/0 00010000:00010000:2.0:1747399689.783842:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1747399689.783846:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 40 00010000:00010000:2.0:1747399689.783849:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.783859:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6d00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399689.783861:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.783868:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399689.783872:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399689.783876:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399689.783918:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.783923:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399689.783938:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.783942:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdec7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604839 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.783974:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399689.783976:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.783980:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399689.783990:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.783994:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399689.783998:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399689.784001:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399689.784011:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.784015:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399689.784019:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.784022:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdec76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604832 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.784031:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399689.784032:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399689.784033:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399689.784057:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081664768:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399689.784116:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399689.784120:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081664704:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399689.784628:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399689.789300:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081664704:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399689.789333:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081664768:192.168.204.160@tcp:103:ldlm_bl_01.0 10000000:01000000:2.0:1747399689.852447:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399689.852468:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 101 10000000:01000000:2.0:1747399689.852474:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399689.852520:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.852529:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.852540:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399689.852566:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664832:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399689.852658:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399689.857538:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664832:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399689.857568:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.857580:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399689.857659:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664896:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399689.857725:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399689.861075:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664896:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399689.861133:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664960:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399689.861207:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399689.872491:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081664960:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399689.873540:0:19216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19216:1832281081665024:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399689.873638:0:19216:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399689.876891:0:19216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19216:1832281081665024:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399689.876939:0:19216:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399689.876946:0:19216:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399689.876947:0:19216:0:(obd_config.c:1460:class_process_config()) marker 67 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399689.876953:0:19216:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399689.876964:0:19216:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399689.876975:0:19216:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000020:01000000:3.0:1747399689.876980:0:19216:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399689.876981:0:19216:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399689.876982:0:19216:0:(obd_config.c:1460:class_process_config()) marker 67 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399689.876984:0:19216:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399689.876985:0:19216:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399689.876986:0:19216:0:(obd_config.c:1460:class_process_config()) marker 69 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399689.876988:0:19216:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399689.876989:0:19216:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399689.876991:0:19216:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747399689.877023:0:19216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19216:1832281081665088:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399689.877095:0:19216:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399689.879024:0:19216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19216:1832281081665088:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399689.879068:0:19216:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399689.879074:0:19216:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399689.879075:0:19216:0:(obd_config.c:1460:class_process_config()) marker 69 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399689.879079:0:19216:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 107 count 105 00000020:01000000:2.0:1747399689.879244:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 101-106 (rc=0) 10000000:01000000:2.0:1747399689.879275:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399689.879282:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.879292:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399689.879300:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399689.879302:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399689.879304:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399689.879358:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.879365:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.879371:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399689.879386:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665152:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399689.879435:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399689.881705:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665152:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399689.881729:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.881738:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399689.881804:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665216:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399689.881970:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399689.883751:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665216:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399689.883795:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399689.883803:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399689.883812:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399690.371566:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399691.374254:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399691.435709:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399691.436379:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399691.436399:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089073408 00000100:00100000:1.0:1747399691.436440:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 41 00000100:00100000:1.0:1747399691.436446:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22530:x1832281089073408:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399691.436459:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399691.436691:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399691.436697:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:22530:x1832281089073408:12345-192.168.204.160@tcp:104: Request processed in 250us (993us total) trans 0 rc 0/0 00010000:00010000:3.0:1747399691.436702:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1747399691.436703:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 41 00010000:00010000:3.0:1747399691.436706:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399691.436712:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399691.436714:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399691.436719:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399691.436724:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399691.436735:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399691.436762:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399691.436766:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399691.436919:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399691.436925:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdec8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6048b7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399691.436933:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081665280:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399691.436944:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399691.436945:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399691.436946:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399691.438800:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399691.440353:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089073472 00000100:00100000:1.0:1747399691.440390:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 42 00000100:00100000:1.0:1747399691.440395:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22530:x1832281089073472:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399691.440418:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399691.440486:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399691.440491:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22530:x1832281089073472:12345-192.168.204.160@tcp:104: Request processed in 95us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399691.440497:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 42 00010000:00010000:2.0:1747399691.440516:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399691.440521:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399691.440527:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399691.440529:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399691.440534:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399691.440538:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399691.440541:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399691.440565:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399691.440569:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399691.440584:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399691.440588:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdec84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6048b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399691.440651:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081665344:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399691.440892:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399691.440893:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399691.440895:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399691.441089:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081665280:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399691.446434:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081665344:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399692.375811:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399692.870342:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399692.870347:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 107 10000000:01000000:1.0:1747399692.870351:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399692.870385:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.870393:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.870402:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399692.870421:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665408:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399692.870491:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:1.0:1747399692.876468:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665408:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399692.876493:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.876504:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399692.877272:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665472:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399692.877392:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:1.0:1747399692.884701:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665472:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399692.884770:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665536:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399692.884861:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:1.0:1747399692.891008:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665536:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399692.891636:0:19234:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19234:1832281081665600:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399692.891727:0:19234:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399692.896360:0:19234:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19234:1832281081665600:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399692.896409:0:19234:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399692.896419:0:19234:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399692.896421:0:19234:0:(obd_config.c:1460:class_process_config()) marker 71 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399692.896426:0:19234:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399692.896429:0:19234:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399692.896451:0:19234:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000020:01000000:3.0:1747399692.896455:0:19234:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399692.896457:0:19234:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399692.896457:0:19234:0:(obd_config.c:1460:class_process_config()) marker 71 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399692.896459:0:19234:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399692.896460:0:19234:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399692.896461:0:19234:0:(obd_config.c:1460:class_process_config()) marker 73 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399692.896463:0:19234:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399692.896465:0:19234:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399692.896467:0:19234:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:3.0:1747399692.896499:0:19234:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19234:1832281081665664:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399692.896564:0:19234:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399692.900380:0:19234:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19234:1832281081665664:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399692.900427:0:19234:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399692.900434:0:19234:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399692.900436:0:19234:0:(obd_config.c:1460:class_process_config()) marker 73 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399692.900441:0:19234:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 113 count 111 00000020:01000000:1.0:1747399692.901413:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 107-112 (rc=0) 10000000:01000000:1.0:1747399692.901440:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399692.901449:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.901461:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399692.901470:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399692.901472:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399692.901475:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399692.901508:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.901513:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.901522:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399692.901542:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665728:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399692.901616:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:1.0:1747399692.903589:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665728:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399692.903614:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.903624:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399692.903690:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665792:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399692.903744:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:1.0:1747399692.909428:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081665792:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399692.909462:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399692.909468:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399692.909475:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1747399693.291532:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399693.291538:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747399693.291539:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399693.291541:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747399693.291584:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081665920:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399693.291678:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1747399693.291683:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081665856:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399693.294233:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081665920:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399693.294601:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081665856:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399693.379337:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399694.149142:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399694.149224:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399694.149267:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089076032 00000100:00100000:0.0:1747399694.149296:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089076096 00000100:00100000:0.0:1747399694.149304:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 43 00000100:00100000:0.0:1747399694.149337:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22609:x1832281089076032:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399694.149349:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399694.149409:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399694.149414:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22609:x1832281089076032:12345-192.168.204.160@tcp:104: Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399694.149420:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 43 00000100:00100000:0.0:1747399694.149432:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 44 00000100:00100000:0.0:1747399694.149434:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22609:x1832281089076096:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399694.149439:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399694.149443:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399694.149447:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.149450:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a1c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399694.149453:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.149458:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399694.149462:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399694.149465:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399694.149480:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399694.149483:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22609:x1832281089076096:12345-192.168.204.160@tcp:104: Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399694.149487:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 44 00010000:00010000:2.0:1747399694.149489:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.149493:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399694.149505:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.149509:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abdec99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604997 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399694.149517:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399694.149521:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.149525:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399694.149526:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399694.149527:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399694.149528:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399694.149529:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399694.149532:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1747399694.149534:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399694.149539:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399694.149544:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081665984:192.168.204.160@tcp:103:ldlm_bl_02.0 10000000:01000000:3.0:1747399694.149547:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399694.149560:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399694.149564:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399694.149568:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399694.149572:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b459f80/0xd95e55596abdec92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604990 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399694.149586:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399694.149587:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399694.149587:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081666048:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399694.149588:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399694.154292:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081666048:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399694.154304:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081665984:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399694.381247:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399694.436470:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399694.436475:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 113 10000000:01000000:0.0:1747399694.436480:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399694.436515:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399694.436524:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399694.436532:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399694.436552:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371197c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666112:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399694.436620:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399694.442780:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371197c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666112:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399694.442805:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.442815:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399694.442881:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666176:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399694.443400:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399694.446162:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666176:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399694.446207:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666240:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399694.446266:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399694.447924:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666240:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399694.449933:0:19249:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19249:1832281081666304:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399694.450009:0:19249:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:3.0:1747399694.452088:0:19249:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19249:1832281081666304:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399694.452123:0:19249:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399694.452131:0:19249:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399694.452132:0:19249:0:(obd_config.c:1460:class_process_config()) marker 75 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399694.452137:0:19249:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399694.452139:0:19249:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399694.452160:0:19249:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000020:01000000:3.0:1747399694.452164:0:19249:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399694.452165:0:19249:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399694.452166:0:19249:0:(obd_config.c:1460:class_process_config()) marker 75 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399694.452167:0:19249:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399694.452169:0:19249:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399694.452176:0:19249:0:(obd_config.c:1460:class_process_config()) marker 77 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399694.452179:0:19249:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399694.452181:0:19249:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399694.452185:0:19249:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747399694.452212:0:19249:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19249:1832281081666368:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399694.452263:0:19249:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:3.0:1747399694.453924:0:19249:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19249:1832281081666368:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399694.453945:0:19249:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399694.453950:0:19249:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399694.453951:0:19249:0:(obd_config.c:1460:class_process_config()) marker 77 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399694.453953:0:19249:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 119 count 117 00000020:01000000:2.0:1747399694.454510:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 113-118 (rc=0) 10000000:01000000:2.0:1747399694.454527:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399694.454533:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.454541:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399694.454548:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399694.454550:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399694.454552:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399694.454572:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.454577:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.454583:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399694.454596:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399694.454642:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399694.456524:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399694.456542:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.456550:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399694.456601:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666496:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399694.456713:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399694.458264:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666496:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399694.458292:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399694.458296:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399694.458304:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399695.382034:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399696.387455:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399696.815176:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399696.815461:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399696.815497:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089079616 00000100:00100000:0.0:1747399696.815530:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089079680 00000100:00100000:0.0:1747399696.815540:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 45 00000100:00100000:0.0:1747399696.815545:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22698:x1832281089079616:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399696.815560:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399696.815956:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399696.815962:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22698:x1832281089079616:12345-192.168.204.160@tcp:104: Request processed in 416us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399696.815969:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 45 00000100:00100000:0.0:1747399696.815982:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 46 00000100:00100000:0.0:1747399696.815985:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22698:x1832281089079680:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399696.815992:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399696.816326:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399696.816332:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22698:x1832281089079680:12345-192.168.204.160@tcp:104: Request processed in 345us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399696.816337:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 46 00010000:00010000:3.0:1747399696.816436:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399696.816441:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816447:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f73c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399696.816450:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816456:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399696.816461:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399696.816465:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399696.816508:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816514:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399696.816536:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816541:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdeca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6049b3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816555:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399696.816556:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816560:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1200 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399696.816562:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816566:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399696.816569:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399696.816572:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399696.816580:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816584:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399696.816587:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816591:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdeca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6049ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399696.816599:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399696.816600:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399696.816605:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399696.816620:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081666560:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399696.816678:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399696.816684:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081666624:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399696.816797:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399696.818939:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081666560:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399696.820814:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081666624:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399697.390168:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399698.301137:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399698.301142:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399698.301144:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399698.301146:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399698.301185:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081666752:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399698.301272:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399698.301277:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081666688:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399698.308064:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081666688:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399698.308092:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081666752:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399698.394348:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399698.610464:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399698.610471:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 119 10000000:01000000:0.0:1747399698.610476:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399698.610523:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399698.610532:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399698.610542:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399698.610566:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399698.610656:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399698.621634:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399698.621664:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399698.621686:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399698.621770:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399698.621843:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399698.630564:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399698.630624:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399698.630698:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399698.636362:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081666944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399698.642075:0:19269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19269:1832281081667008:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399698.642185:0:19269:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399698.652549:0:19269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19269:1832281081667008:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399698.652601:0:19269:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399698.652611:0:19269:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399698.652613:0:19269:0:(obd_config.c:1460:class_process_config()) marker 79 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399698.652618:0:19269:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399698.652621:0:19269:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399698.652633:0:19269:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000020:01000000:3.0:1747399698.652636:0:19269:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399698.652638:0:19269:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399698.652639:0:19269:0:(obd_config.c:1460:class_process_config()) marker 79 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399698.652641:0:19269:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399698.652642:0:19269:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399698.652643:0:19269:0:(obd_config.c:1460:class_process_config()) marker 81 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399698.652645:0:19269:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399698.652646:0:19269:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399698.652649:0:19269:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:3.0:1747399698.652693:0:19269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19269:1832281081667072:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399698.652769:0:19269:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399698.660559:0:19269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19269:1832281081667072:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399698.660609:0:19269:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399698.660616:0:19269:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399698.660618:0:19269:0:(obd_config.c:1460:class_process_config()) marker 81 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399698.660621:0:19269:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 125 count 123 00000020:01000000:2.0:1747399698.664124:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 119-124 (rc=0) 10000000:01000000:2.0:1747399698.664163:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399698.664171:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399698.664183:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399698.664193:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399698.664196:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399698.664198:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399698.664234:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399698.664240:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399698.664250:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399698.664289:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399698.664411:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399698.673695:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399698.673725:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399698.673735:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399698.673813:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667200:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399698.673880:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399698.681414:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667200:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399698.681466:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399698.681475:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399698.681485:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399699.395576:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399700.398362:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399701.400919:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399701.476045:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399701.477459:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399701.477965:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399701.477994:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089082560 00000100:00100000:1.0:1747399701.478038:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089082624 00000100:00100000:1.0:1747399701.478048:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 47 00000100:00100000:1.0:1747399701.478053:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22988:x1832281089082560:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399701.478069:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399701.479902:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399701.479918:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:22988:x1832281089082560:12345-192.168.204.160@tcp:104: Request processed in 1859us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399701.479929:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 47 00000100:00100000:1.0:1747399701.479962:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 48 00000100:00100000:1.0:1747399701.479969:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22988:x1832281089082624:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399701.479982:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.480099:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399701.480106:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.480113:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7600 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399701.480116:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.480136:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399701.480142:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399701.480146:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399701.483562:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484168:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399701.484207:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484213:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604a31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484251:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399701.484253:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484258:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1200 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399701.484261:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484268:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399701.484272:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399701.484276:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399701.484305:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484332:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399701.484337:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484341:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1200/0xd95e55596abdecae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604a2a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399701.484352:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399701.484353:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399701.485913:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1747399701.485930:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:22988:x1832281089082624:12345-192.168.204.160@tcp:104: Request processed in 5956us (8470us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399701.485941:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 48 00000100:00100000:3.0:1747399701.487140:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081667264:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399701.487233:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399701.487239:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081667328:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399701.487538:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399701.487653:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399701.490071:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081667328:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399701.490273:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081667264:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399702.403753:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399703.252777:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399703.252785:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 125 10000000:01000000:3.0:1747399703.252790:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399703.252842:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399703.252851:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399703.252861:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399703.252904:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399703.253004:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bc00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399703.262399:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399703.262430:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399703.262444:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399703.262528:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667456:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399703.262697:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bc00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399703.267100:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667456:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399703.267428:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667520:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399703.267514:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bc00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399703.274138:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667520:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399703.277102:0:19321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19321:1832281081667584:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399703.277269:0:19321:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bc00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399703.286027:0:19321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19321:1832281081667584:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399703.286079:0:19321:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399703.286089:0:19321:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399703.286091:0:19321:0:(obd_config.c:1460:class_process_config()) marker 83 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399703.286097:0:19321:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399703.286108:0:19321:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399703.286760:0:19321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19321:1832281081667648:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399703.288919:0:19321:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bc00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399703.292951:0:19321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19321:1832281081667648:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399703.293011:0:19321:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399703.293021:0:19321:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399703.293025:0:19321:0:(obd_config.c:1460:class_process_config()) marker 83 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399703.293030:0:19321:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 128 count 126 00000020:01000000:0.0:1747399703.293693:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 125-127 (rc=0) 10000000:01000000:0.0:1747399703.293714:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399703.293723:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399703.293733:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399703.293742:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399703.293745:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399703.293747:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399703.293779:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399703.293784:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399703.293791:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399703.293813:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399703.293874:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753840 going to sleep for 6 seconds 00000100:00100000:0.0:1747399703.299822:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1747399703.299852:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399703.299863:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399703.299955:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667776:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747399703.300028:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753840 going to sleep for 6 seconds 00000100:00100000:0.0:1747399703.303706:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081667776:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1747399703.303755:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1747399703.303764:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399703.303773:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399703.307602:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081667840:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00080000:2.0:1747399703.307860:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399703.307864:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399703.307866:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399703.307868:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399703.312348:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081667840:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399703.406038:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399704.408376:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399705.409505:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399706.413455:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399707.415408:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399707.912500:0:19953:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399707.912505:0:19953:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 2d: pool_add: OSTs that don't exist should be rejected ========================================================== 08:48:27 (1747399707) 00000100:00080000:2.0:1747399708.315497:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399708.315503:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399708.315505:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399708.315507:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399708.315532:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081667904:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399708.315532:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081667968:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399708.318911:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081667904:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399708.319041:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081667968:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399708.417511:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399708.718470:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399708.719007:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399708.720195:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089085824 00000100:00100000:1.0:1747399708.720232:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089085888 00000100:00100000:1.0:1747399708.720243:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 49 00000100:00100000:1.0:1747399708.720248:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:23405:x1832281089085824:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399708.720265:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722008:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399708.722023:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:23405:x1832281089085824:12345-192.168.204.160@tcp:104: Request processed in 1771us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399708.722048:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 49 00000100:00100000:1.0:1747399708.722074:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 50 00000100:00100000:1.0:1747399708.722079:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:23405:x1832281089085888:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399708.722090:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722144:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399708.722148:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:23405:x1832281089085888:12345-192.168.204.160@tcp:104: Request processed in 70us (3143us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399708.722153:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 50 00010000:00010000:1.0:1747399708.722170:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1747399708.722175:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722182:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1440 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399708.722185:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722192:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399708.722197:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399708.722201:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399708.722234:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722239:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399708.722263:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722268:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1440/0xd95e55596abdecc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b0a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722305:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1747399708.722307:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722336:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399708.722338:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722343:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399708.722346:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399708.722350:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399708.722364:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722370:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399708.722374:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722378:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b03 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399708.722388:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399708.722388:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399708.722394:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399708.722411:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081668032:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1747399708.722451:0:1862:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1747399708.722457:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081668096:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399708.722695:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399708.725302:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081668096:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1747399708.725351:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081668032:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399709.419665:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399710.133552:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399710.133560:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 128 10000000:01000000:2.0:1747399710.133566:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399710.133613:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.133624:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.133634:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399710.133664:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668160:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399710.133763:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399710.140563:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668160:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399710.140590:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.140821:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399710.140932:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668224:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399710.141004:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399710.145828:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668224:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399710.145909:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668288:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399710.146261:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399710.149988:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668288:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399710.151706:0:19986:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19986:1832281081668352:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399710.151811:0:19986:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399710.154629:0:19986:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19986:1832281081668352:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399710.154676:0:19986:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399710.154685:0:19986:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399710.154686:0:19986:0:(obd_config.c:1460:class_process_config()) marker 85 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747399710.154693:0:19986:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399710.154695:0:19986:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399710.154717:0:19986:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747399710.154751:0:19986:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19986:1832281081668416:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399710.154821:0:19986:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399710.157503:0:19986:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:19986:1832281081668416:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399710.157553:0:19986:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399710.157559:0:19986:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399710.157561:0:19986:0:(obd_config.c:1460:class_process_config()) marker 85 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747399710.157565:0:19986:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 131 count 129 00000020:01000000:2.0:1747399710.157741:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 128-130 (rc=0) 10000000:01000000:2.0:1747399710.157764:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399710.157772:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.157783:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399710.157792:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399710.157794:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399710.157797:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399710.157829:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.157834:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.157842:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399710.157869:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668480:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399710.157930:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399710.160376:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668480:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399710.160404:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.160414:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399710.160502:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668544:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399710.161398:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399710.164771:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668544:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399710.164821:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399710.164830:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399710.164841:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399710.424924:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399711.425832:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399712.427505:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399713.324391:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399713.324396:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399713.324398:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399713.324400:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399713.324422:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081668672:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399713.324483:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399713.324487:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081668608:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399713.336715:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081668608:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399713.336731:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081668672:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:1.0:1747399713.431765:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399714.433821:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399714.560014:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399714.560495:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089089728 00000100:00100000:1.0:1747399714.560540:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 51 00000100:00100000:1.0:1747399714.560601:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:23851:x1832281089089728:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399714.560613:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399714.560677:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399714.560681:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:23851:x1832281089089728:12345-192.168.204.160@tcp:104: Request processed in 82us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399714.560686:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 51 00010000:00010000:2.0:1747399714.560761:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399714.560765:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399714.560782:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399714.560785:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399714.560790:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399714.560794:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399714.560798:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399714.560875:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399714.560880:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399714.560893:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399714.560897:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdecd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b1f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399714.560919:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399714.560920:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399714.560921:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399714.560933:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081668736:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1747399714.561040:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399714.561091:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089089856 00000100:00100000:1.0:1747399714.561105:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 52 00000100:00100000:1.0:1747399714.561109:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372e76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:23851:x1832281089089856:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399714.561114:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399714.561134:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399714.561144:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372e76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:23851:x1832281089089856:12345-192.168.204.160@tcp:104: Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399714.561149:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 52 00010000:00010000:1.0:1747399714.561158:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1747399714.561161:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399714.561166:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7600 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399714.561168:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399714.561172:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399714.561176:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399714.561179:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399714.561190:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399714.561194:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399714.561216:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399714.561221:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abdecca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604b18 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399714.561232:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399714.561233:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399714.561234:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399714.561239:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1747399714.561250:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081668800:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399714.563122:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081668736:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1747399714.563190:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081668800:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399715.436466:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399715.587415:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399715.587420:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 131 10000000:01000000:3.0:1747399715.587425:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399715.587461:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399715.587469:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399715.587476:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399715.587496:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668864:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399715.587569:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399715.590941:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668864:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399715.590962:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399715.590971:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399715.591026:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668928:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399715.591086:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399715.592886:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668928:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399715.592933:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668992:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399715.592995:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399715.597409:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081668992:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399715.597795:0:20070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20070:1832281081669056:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399715.597879:0:20070:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399715.600492:0:20070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20070:1832281081669056:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399715.600536:0:20070:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399715.600544:0:20070:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399715.600546:0:20070:0:(obd_config.c:1460:class_process_config()) marker 87 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399715.600550:0:20070:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399715.600552:0:20070:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399715.600606:0:20070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20070:1832281081669120:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399715.600674:0:20070:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399715.605992:0:20070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20070:1832281081669120:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399715.606042:0:20070:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399715.606048:0:20070:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399715.606050:0:20070:0:(obd_config.c:1460:class_process_config()) marker 87 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399715.606053:0:20070:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 134 count 132 00000020:01000000:0.0:1747399715.606198:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 131-133 (rc=0) 10000000:01000000:0.0:1747399715.606221:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399715.606228:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399715.606240:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399715.606253:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399715.606256:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399715.606259:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399715.606291:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399715.606305:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399715.606355:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399715.606374:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669184:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399715.606445:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67530c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399715.609065:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669184:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399715.609092:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399715.609101:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399715.609176:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669248:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399715.609238:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399715.612470:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669248:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399715.612529:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399715.612538:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399715.612549:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399716.441885:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399717.446371:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399718.333199:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399718.333204:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399718.333206:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399718.333208:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399718.336771:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081669312:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399718.337065:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081669376:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399718.341283:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081669376:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399718.341943:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081669312:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399718.447394:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399719.450875:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399720.451826:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399720.823951:0:20701:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399720.823954:0:20701:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 2e: pool_add: OST already in a pool should be rejected ========================================================== 08:48:40 (1747399720) 00000100:00100000:0.0:1747399721.446126:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399721.446182:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399721.446230:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089092864 00000100:00100000:0.0:1747399721.446262:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089093056 00000100:00100000:0.0:1747399721.446272:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 53 00000100:00100000:0.0:1747399721.446277:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:24280:x1832281089092864:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399721.446292:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399721.446391:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399721.446395:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:24280:x1832281089092864:12345-192.168.204.160@tcp:104: Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399721.446401:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 53 00000100:00100000:0.0:1747399721.446414:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 54 00000100:00100000:0.0:1747399721.446417:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:24280:x1832281089093056:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399721.446423:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399721.446450:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399721.446462:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:24280:x1832281089093056:12345-192.168.204.160@tcp:104: Request processed in 44us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399721.446467:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 54 00010000:00010000:2.0:1747399721.446828:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399721.446834:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.446841:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1680 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399721.446844:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.446850:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399721.446856:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399721.446860:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399721.446901:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.446905:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399721.446921:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.446926:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdecdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604bc0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.446943:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399721.446944:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.446949:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399721.446950:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399721.446958:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399721.446961:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399721.446965:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399721.446969:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399721.446979:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.446983:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399721.446986:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399721.446987:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081669440:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399721.446990:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b21f80/0xd95e55596abdecd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604bab expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399721.447000:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399721.447001:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399721.447002:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399721.447014:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081669504:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1747399721.458187:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399721.458352:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081669504:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399721.458454:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081669440:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399722.455689:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399723.160447:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399723.160455:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 134 10000000:01000000:0.0:1747399723.160462:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399723.160510:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399723.160521:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399723.160530:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399723.160558:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669568:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399723.161164:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753f00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399723.164566:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669568:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399723.164627:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399723.164639:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399723.164731:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669632:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399723.164799:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399723.166512:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669632:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399723.166557:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669696:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399723.166622:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399723.169416:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669696:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399723.172107:0:20734:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20734:1832281081669760:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399723.172217:0:20734:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399723.174424:0:20734:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20734:1832281081669760:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399723.174463:0:20734:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399723.174470:0:20734:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399723.174471:0:20734:0:(obd_config.c:1460:class_process_config()) marker 89 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747399723.174476:0:20734:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399723.174478:0:20734:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399723.174495:0:20734:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747399723.174604:0:20734:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20734:1832281081669824:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399723.174679:0:20734:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399723.177271:0:20734:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20734:1832281081669824:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399723.177351:0:20734:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399723.177357:0:20734:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399723.177359:0:20734:0:(obd_config.c:1460:class_process_config()) marker 89 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747399723.177364:0:20734:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 138 count 135 00000020:01000000:2.0:1747399723.178268:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 134-137 (rc=0) 10000000:01000000:2.0:1747399723.178293:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399723.178301:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399723.178332:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399723.178341:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399723.178344:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399723.178346:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399723.178374:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399723.178380:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399723.178388:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399723.178414:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669888:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399723.178498:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399723.183438:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669888:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399723.183467:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399723.183479:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399723.183559:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669952:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399723.183652:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399723.189465:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081669952:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399723.189515:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399723.189523:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399723.189533:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399723.339528:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399723.339534:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399723.339536:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399723.339538:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399723.339563:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081670016:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399723.339563:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081670080:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399723.342889:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081670080:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399723.343208:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081670016:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399723.458715:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399724.338882:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399724.338957:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399724.338975:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089096192 00000100:00100000:1.0:1747399724.340091:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 55 00000100:00100000:1.0:1747399724.340097:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:24467:x1832281089096192:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399724.340109:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399724.344840:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399724.344853:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:24467:x1832281089096192:12345-192.168.204.160@tcp:104: Request processed in 4751us (5973us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399724.344863:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 55 00010000:00010000:2.0:1747399724.345036:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399724.345041:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399724.345051:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399724.345054:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399724.345060:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399724.345064:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399724.345068:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399724.345112:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399724.345116:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399724.345130:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399724.345134:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdeced lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604c0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399724.345146:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399724.345147:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399724.345148:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399724.345155:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399724.345169:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081670144:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1747399724.345774:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399724.345802:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089096256 00000100:00100000:1.0:1747399724.345822:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 56 00000100:00100000:1.0:1747399724.345826:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372e76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:24467:x1832281089096256:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399724.345833:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399724.345871:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399724.345875:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372e76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:24467:x1832281089096256:12345-192.168.204.160@tcp:104: Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399724.345880:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 56 00010000:00010000:3.0:1747399724.345997:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399724.346005:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399724.346011:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1680 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399724.346013:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399724.346018:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399724.346022:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399724.346026:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399724.346050:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399724.346055:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399724.346062:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399724.346066:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1680/0xd95e55596abdece6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604c06 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399724.346078:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399724.346078:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399724.346080:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399724.346083:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399724.346091:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081670208:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399724.348490:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081670208:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399724.348509:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081670144:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399724.460201:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399725.461527:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399726.011618:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399726.011623:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 138 10000000:01000000:2.0:1747399726.011628:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399726.011664:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399726.011672:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399726.011680:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399726.011701:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670272:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399726.012287:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399726.016965:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670272:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399726.016986:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399726.016995:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399726.017049:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670336:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399726.017104:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399726.026002:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670336:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399726.026061:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670400:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399726.026126:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399726.028018:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670400:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399726.028747:0:20773:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20773:1832281081670464:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399726.028804:0:20773:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399726.030544:0:20773:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20773:1832281081670464:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399726.030582:0:20773:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399726.030590:0:20773:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399726.030592:0:20773:0:(obd_config.c:1460:class_process_config()) marker 91 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399726.030598:0:20773:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399726.030600:0:20773:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399726.030609:0:20773:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399726.030629:0:20773:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20773:1832281081670528:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399726.030679:0:20773:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399726.032251:0:20773:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20773:1832281081670528:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399726.032275:0:20773:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399726.032280:0:20773:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399726.032282:0:20773:0:(obd_config.c:1460:class_process_config()) marker 91 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399726.032285:0:20773:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 141 count 138 00000020:01000000:2.0:1747399726.032490:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 138-140 (rc=0) 10000000:01000000:2.0:1747399726.032509:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399726.032515:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399726.032523:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399726.032531:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399726.032532:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399726.032534:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399726.032561:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399726.032566:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399726.032572:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399726.032586:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670592:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399726.032999:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399726.036181:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670592:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399726.036201:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399726.036211:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399726.036267:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670656:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399726.036304:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399726.038125:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670656:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399726.038167:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399726.038172:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399726.038180:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399726.464011:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399727.465514:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399728.348025:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081670720:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00080000:2.0:1747399728.348167:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399728.348171:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399728.348183:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399728.348185:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399728.348204:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081670784:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399728.350636:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081670784:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399728.354278:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081670720:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399728.467722:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399728.584567:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399728.584600:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399728.584636:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089098880 00000100:00100000:1.0:1747399728.584653:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089098944 00000100:00100000:0.0:1747399728.584665:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 57 00000100:00100000:0.0:1747399728.584670:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:24819:x1832281089098880:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399728.584683:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399728.584749:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399728.584753:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:24819:x1832281089098880:12345-192.168.204.160@tcp:104: Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399728.584768:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 57 00000100:00100000:0.0:1747399728.584781:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 58 00000100:00100000:0.0:1747399728.584784:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:24819:x1832281089098944:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399728.584789:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399728.584820:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399728.584824:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:24819:x1832281089098944:12345-192.168.204.160@tcp:104: Request processed in 40us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399728.584830:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 58 00010000:00010000:2.0:1747399728.585130:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399728.585135:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585141:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7cc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399728.585144:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585150:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399728.585154:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399728.585158:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399728.585184:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585188:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399728.585202:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585206:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abdecfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604ce6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585226:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399728.585228:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585232:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399728.585234:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585238:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399728.585242:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399728.585246:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399728.585254:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585257:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399728.585260:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585264:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abdecf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cdf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399728.585272:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399728.585273:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399728.585274:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399728.585295:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081670912:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399728.585359:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399728.585368:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081670848:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399728.586187:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399728.587560:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081670912:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399728.588230:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081670848:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399729.470049:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399730.054588:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399730.054594:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 141 10000000:01000000:2.0:1747399730.054598:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399730.054633:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.054641:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.054649:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399730.054670:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670976:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399730.054737:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399730.059176:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081670976:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399730.059201:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.059210:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399730.059260:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671040:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399730.059300:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399730.063068:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671040:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399730.063123:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671104:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399730.063168:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399730.067521:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671104:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399730.067871:0:20830:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20830:1832281081671168:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399730.069695:0:20830:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:3.0:1747399730.073251:0:20830:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20830:1832281081671168:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399730.073285:0:20830:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399730.073293:0:20830:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399730.073294:0:20830:0:(obd_config.c:1460:class_process_config()) marker 93 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399730.073299:0:20830:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399730.073301:0:20830:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399730.073333:0:20830:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399730.073360:0:20830:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20830:1832281081671232:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399730.073423:0:20830:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:3.0:1747399730.076878:0:20830:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20830:1832281081671232:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399730.076908:0:20830:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399730.076921:0:20830:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399730.076923:0:20830:0:(obd_config.c:1460:class_process_config()) marker 93 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399730.076927:0:20830:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 144 count 141 00000020:01000000:2.0:1747399730.077290:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 141-143 (rc=0) 10000000:01000000:2.0:1747399730.077307:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399730.077327:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.077336:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399730.077344:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399730.077346:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399730.077347:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399730.077367:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.077371:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.077377:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399730.077391:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399730.077952:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399730.080887:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399730.080907:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.080923:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399730.080979:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671360:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399730.081014:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399730.084525:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671360:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399730.084561:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399730.084567:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.084575:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399730.472102:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399731.349627:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399731.349678:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399731.349704:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089102144 00000100:00100000:0.0:1747399731.349709:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089102208 00000100:00100000:0.0:1747399731.349732:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 59 00000100:00100000:0.0:1747399731.349736:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:24960:x1832281089102144:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399731.349747:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399731.349813:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399731.349817:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:24960:x1832281089102144:12345-192.168.204.160@tcp:104: Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399731.349823:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 59 00000100:00100000:0.0:1747399731.349836:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 60 00000100:00100000:0.0:1747399731.349839:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:24960:x1832281089102208:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399731.349844:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399731.349868:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1747399731.349888:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1747399731.349892:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399731.349892:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:24960:x1832281089102208:12345-192.168.204.160@tcp:104: Request processed in 52us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399731.349896:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 60 00010000:00010000:3.0:1747399731.349902:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7cc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399731.349905:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399731.349913:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399731.349918:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399731.349918:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399731.349922:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399731.349923:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399731.349929:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399731.349931:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399731.349936:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399731.349941:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399731.349944:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399731.349975:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399731.349978:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399731.349980:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399731.349983:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399731.349997:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399731.350002:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cfb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399731.350027:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399731.350028:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399731.350029:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399731.350047:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081671488:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399731.350352:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399731.350357:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7a80/0xd95e55596abded02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604cf4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399731.350377:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399731.350378:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399731.350380:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399731.350391:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081671424:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399731.355861:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081671424:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399731.355872:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081671488:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399731.474139:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399732.476282:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399733.236576:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399733.236581:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 144 10000000:01000000:0.0:1747399733.236586:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399733.236621:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399733.236628:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399733.236635:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399733.236653:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671552:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399733.236727:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399733.243393:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671552:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399733.243414:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399733.243438:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399733.243501:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671616:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399733.243574:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399733.247249:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671616:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399733.247297:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671680:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399733.248740:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399733.254558:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671680:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399733.255609:0:20868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20868:1832281081671744:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399733.255700:0:20868:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399733.262274:0:20868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20868:1832281081671744:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399733.262342:0:20868:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399733.262350:0:20868:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399733.262352:0:20868:0:(obd_config.c:1460:class_process_config()) marker 95 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399733.262358:0:20868:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399733.262360:0:20868:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399733.262438:0:20868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20868:1832281081671808:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399733.263438:0:20868:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5ba80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399733.269358:0:20868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:20868:1832281081671808:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399733.269407:0:20868:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399733.269414:0:20868:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399733.269416:0:20868:0:(obd_config.c:1460:class_process_config()) marker 95 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399733.269431:0:20868:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 147 count 144 00000020:01000000:2.0:1747399733.269762:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:2.0:1747399733.269785:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399733.269792:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399733.269803:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399733.269812:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399733.269814:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399733.269817:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399733.269847:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399733.269852:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399733.269860:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399733.269879:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399733.271724:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399733.275379:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399733.275410:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399733.275432:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399733.275525:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671936:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399733.275586:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399733.277907:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081671936:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399733.277951:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399733.277958:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399733.277968:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399733.355541:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399733.355546:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399733.355549:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399733.355551:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399733.355577:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399733.355597:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081672000:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399733.359404:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081672000:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399733.479099:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399734.479392:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399735.481467:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399736.483509:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399736.582276:0:21487:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399736.582279:0:21487:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 3a: pool_remove: non-existant pool ===== 08:48:55 (1747399735) 00010000:00010000:2.0:1747399737.486118:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399738.363429:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399738.363438:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399738.363439:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399738.363441:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399738.363466:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672064:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399738.363536:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399738.363539:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081672128:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399738.366825:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672064:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399738.367012:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081672128:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399738.490785:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399739.504890:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399739.941025:0:22119:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399739.941029:0:22119:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 3b: pool_remove: non-existant fsname === 08:48:59 (1747399739) 00010000:00010000:2.0:1747399740.508197:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399741.509459:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399742.512863:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399743.371606:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399743.371609:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399743.371611:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399743.371613:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399743.371631:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672192:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399743.371699:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399743.371704:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081672256:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399743.377423:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081672256:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399743.378395:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672192:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399743.516877:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399743.528510:0:22749:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399743.528513:0:22749:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 3c: pool_remove: Invalid pool name ===== 08:49:02 (1747399742) 00010000:00010000:2.0:1747399744.520975:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399745.524166:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399746.525548:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399746.779094:0:23379:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399746.779097:0:23379:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 3d: pool_remove: OST index combinations ========================================================== 08:49:06 (1747399746) 00000100:00100000:0.0:1747399747.317480:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399747.317516:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399747.317537:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1747399747.317547:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089105856 00000100:00100000:1.0:1747399747.317549:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089105920 00000100:00100000:0.0:1747399747.317570:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 61 00000100:00100000:0.0:1747399747.317574:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:26354:x1832281089105856:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399747.317584:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399747.317634:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399747.317637:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:26354:x1832281089105856:12345-192.168.204.160@tcp:104: Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399747.317648:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 61 00000100:00100000:0.0:1747399747.317658:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 62 00000100:00100000:0.0:1747399747.317661:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26354:x1832281089105920:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399747.317665:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317670:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399747.317675:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317681:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7cc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399747.317683:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317688:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399747.317693:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399747.317693:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399747.317696:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26354:x1832281089105920:12345-192.168.204.160@tcp:104: Request processed in 34us (180us total) trans 0 rc 0/0 10000000:01000000:2.0:1747399747.317697:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747399747.317699:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 62 00010000:00010000:2.0:1747399747.317723:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317728:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399747.317739:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317744:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7cc0/0xd95e55596abded17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604dd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317760:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399747.317767:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317771:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f18c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399747.317773:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317777:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399747.317781:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399747.317784:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399747.317797:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317801:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399747.317805:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317808:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604dcd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399747.317818:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399747.317819:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399747.317821:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399747.317833:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672320:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399747.317885:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399747.317891:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672384:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399747.317989:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399747.322586:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672384:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399747.322596:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672320:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399747.527498:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399748.383591:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399748.383596:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399748.383598:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399748.383600:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399748.383630:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081672512:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399748.383791:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672448:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399748.387949:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081672512:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399748.389820:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081672448:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399748.531776:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399749.156712:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399749.156718:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 147 10000000:01000000:0.0:1747399749.156722:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399749.156754:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399749.156762:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399749.156770:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399749.156790:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399749.156864:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399749.160224:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399749.160244:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399749.160253:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399749.160344:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399749.161148:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399749.163024:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399749.163067:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672704:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399749.163136:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399749.165738:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672704:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399749.166774:0:23412:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23412:1832281081672768:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399749.166846:0:23412:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5ba80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399749.172107:0:23412:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23412:1832281081672768:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399749.172153:0:23412:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399749.172161:0:23412:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399749.172163:0:23412:0:(obd_config.c:1460:class_process_config()) marker 97 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747399749.172168:0:23412:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399749.172170:0:23412:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399749.172185:0:23412:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747399749.172210:0:23412:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23412:1832281081672832:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399749.172277:0:23412:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399749.180896:0:23412:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23412:1832281081672832:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399749.180934:0:23412:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399749.180941:0:23412:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399749.180944:0:23412:0:(obd_config.c:1460:class_process_config()) marker 97 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747399749.180947:0:23412:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 150 count 147 00000020:01000000:2.0:1747399749.181086:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:2.0:1747399749.181104:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399749.181116:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399749.181136:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399749.181143:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399749.181144:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399749.181146:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399749.181168:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399749.181174:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399749.181180:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399749.181195:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672896:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399749.182400:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399749.184518:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672896:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399749.184540:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399749.184549:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399749.184602:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672960:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399749.187104:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5df00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399749.194113:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081672960:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399749.194167:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399749.194174:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399749.194182:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399749.533900:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399750.336796:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399750.337238:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399750.337435:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089109120 00000100:00100000:1.0:1747399750.337468:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089109184 00000100:00100000:1.0:1747399750.337478:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 63 00000100:00100000:1.0:1747399750.337484:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:26560:x1832281089109120:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399750.337498:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399750.337573:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399750.337578:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:26560:x1832281089109120:12345-192.168.204.160@tcp:104: Request processed in 94us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399750.337584:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 63 00000100:00100000:1.0:1747399750.337599:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 64 00000100:00100000:1.0:1747399750.337602:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26560:x1832281089109184:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399750.337607:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399750.337639:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399750.337642:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26560:x1832281089109184:12345-192.168.204.160@tcp:104: Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399750.337656:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 64 00010000:00010000:2.0:1747399750.337811:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399750.337816:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337822:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399750.337825:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337831:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399750.337836:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399750.337840:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399750.337874:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337879:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399750.337893:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337897:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abded25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337921:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399750.337923:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337927:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f18c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399750.337928:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337933:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399750.337937:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399750.337940:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399750.337950:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337955:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399750.337958:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337963:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f18c0/0xd95e55596abded1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e44 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.337973:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399750.337974:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399750.337975:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399750.337998:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673088:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399750.338040:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399750.338049:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673024:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399750.338140:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399750.340635:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673024:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399750.340646:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673088:192.168.204.160@tcp:103:ldlm_bl_02.0 10000000:01000000:2.0:1747399750.357451:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399750.357458:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 150 10000000:01000000:2.0:1747399750.357464:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399750.357517:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.357528:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.357538:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399750.357562:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673152:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399750.357654:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dcc0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399750.362652:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673152:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399750.362683:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.362695:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399750.362782:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673216:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399750.362855:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dcc0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399750.366531:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673216:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399750.366608:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673280:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399750.367299:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dcc0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399750.369917:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673280:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399750.372159:0:23449:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23449:1832281081673344:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399750.372254:0:23449:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399750.378289:0:23449:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23449:1832281081673344:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399750.378367:0:23449:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399750.378376:0:23449:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399750.378385:0:23449:0:(obd_config.c:1460:class_process_config()) marker 99 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399750.378391:0:23449:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399750.378393:0:23449:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399750.378404:0:23449:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399750.378435:0:23449:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23449:1832281081673408:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399750.378506:0:23449:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399750.381373:0:23449:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23449:1832281081673408:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399750.381421:0:23449:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399750.381427:0:23449:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399750.381429:0:23449:0:(obd_config.c:1460:class_process_config()) marker 99 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399750.381432:0:23449:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 153 count 150 00000020:01000000:2.0:1747399750.381597:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:2.0:1747399750.381620:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399750.381628:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.381639:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399750.381648:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399750.381650:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399750.381652:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399750.381679:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.381684:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399750.381692:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399750.381709:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673472:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399750.381758:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399750.385250:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673472:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399750.385276:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399750.385287:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399750.385381:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673536:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399750.385445:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399750.387723:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673536:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399750.387765:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399750.387772:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399750.387781:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399750.536993:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399751.539585:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399752.542544:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399752.851519:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399752.851580:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399752.851637:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089113024 00000100:00100000:0.0:1747399752.851669:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089113088 00000100:00100000:0.0:1747399752.851678:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 65 00000100:00100000:0.0:1747399752.851682:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:26634:x1832281089113024:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399752.851704:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399752.853272:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399752.853283:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:26634:x1832281089113024:12345-192.168.204.160@tcp:104: Request processed in 1599us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399752.853293:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 65 00000100:00100000:0.0:1747399752.853336:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 66 00000100:00100000:0.0:1747399752.853341:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26634:x1832281089113088:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399752.853351:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399752.853463:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399752.853469:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399752.853476:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f73c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399752.853479:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399752.853486:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399752.853491:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399752.853495:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399752.853530:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399752.853535:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399752.853561:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399752.853565:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abded33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e60 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399752.853580:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399752.853581:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399752.853582:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399752.853614:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399752.853641:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673600:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1747399752.853985:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399752.853990:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26634:x1832281089113088:12345-192.168.204.160@tcp:104: Request processed in 648us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399752.853995:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 66 00010000:00010000:2.0:1747399752.854082:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399752.854090:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399752.854112:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7600 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399752.854114:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399752.854121:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399752.854125:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399752.854129:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399752.854165:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399752.854169:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399752.854180:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399752.854185:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7600/0xd95e55596abded2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604e59 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399752.854220:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399752.854221:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399752.854222:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399752.854230:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399752.854539:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081673664:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399752.859798:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673600:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399752.859900:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081673664:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00080000:2.0:1747399753.387515:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399753.387522:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399753.387537:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399753.387540:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399753.387580:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081673792:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399753.387679:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399753.387684:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673728:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399753.393016:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081673728:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399753.393035:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081673792:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399753.544005:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399754.545649:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399754.845659:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399754.845665:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 153 10000000:01000000:2.0:1747399754.845671:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399754.845715:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399754.845724:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399754.845733:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399754.845755:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673856:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399754.845847:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399754.850414:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673856:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399754.850443:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399754.850469:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399754.850546:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673920:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399754.851423:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399754.861556:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673920:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399754.861622:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673984:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399754.861721:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399754.867360:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081673984:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399754.867838:0:23461:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23461:1832281081674048:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399754.867961:0:23461:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399754.872121:0:23461:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23461:1832281081674048:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399754.872153:0:23461:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399754.872161:0:23461:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399754.872163:0:23461:0:(obd_config.c:1460:class_process_config()) marker 101 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399754.872168:0:23461:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399754.872170:0:23461:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399754.872179:0:23461:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399754.872202:0:23461:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23461:1832281081674112:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399754.872249:0:23461:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399754.876412:0:23461:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23461:1832281081674112:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399754.876443:0:23461:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399754.876449:0:23461:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399754.876451:0:23461:0:(obd_config.c:1460:class_process_config()) marker 101 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399754.876454:0:23461:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 156 count 153 00000020:01000000:1.0:1747399754.876546:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:1.0:1747399754.876564:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399754.876570:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399754.876578:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399754.876585:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399754.876587:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399754.876589:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399754.876611:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399754.876616:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399754.876622:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399754.876636:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674176:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399754.876687:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ec00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399754.880728:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674176:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399754.880747:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399754.880757:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399754.880817:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674240:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399754.880860:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ec00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399754.883280:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674240:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399754.883331:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399754.883337:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399754.883346:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399755.361021:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399755.361064:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399755.361102:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089115200 00000100:00100000:0.0:1747399755.361126:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089115264 00000100:00100000:0.0:1747399755.361135:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 67 00000100:00100000:0.0:1747399755.361140:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:26721:x1832281089115200:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399755.361151:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399755.361216:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399755.361220:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:26721:x1832281089115200:12345-192.168.204.160@tcp:104: Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399755.361227:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 67 00000100:00100000:0.0:1747399755.361241:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 68 00000100:00100000:0.0:1747399755.361244:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:26721:x1832281089115264:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399755.361249:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399755.361275:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399755.361278:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:26721:x1832281089115264:12345-192.168.204.160@tcp:104: Request processed in 33us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399755.361283:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 68 00010000:00010000:3.0:1747399755.361566:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399755.361570:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361584:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a1c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399755.361587:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361593:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399755.361597:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399755.361601:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399755.361626:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361630:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399755.361642:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361646:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a1c0/0xd95e55596abded41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604f39 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361657:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399755.361658:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361662:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399755.361663:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361666:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399755.361677:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399755.361680:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399755.361693:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361696:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399755.361698:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361702:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abded3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604f32 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399755.361709:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399755.361710:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399755.361712:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399755.361723:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081674304:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399755.361754:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399755.361759:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081674368:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399755.361880:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399755.366953:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081674368:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399755.366963:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081674304:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399755.548596:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399756.538374:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399756.538379:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 156 10000000:01000000:3.0:1747399756.538383:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399756.538415:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399756.538428:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399756.538437:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399756.538457:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399756.538519:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399756.541096:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399756.541115:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399756.541124:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399756.541173:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674496:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399756.541211:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399756.546051:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674496:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399756.546104:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674560:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399756.546168:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00010000:00010000:3.0:1747399756.553157:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399756.554701:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674560:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399756.555351:0:23485:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23485:1832281081674624:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399756.555403:0:23485:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399756.563411:0:23485:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23485:1832281081674624:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399756.563448:0:23485:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399756.563456:0:23485:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399756.563457:0:23485:0:(obd_config.c:1460:class_process_config()) marker 103 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399756.563463:0:23485:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399756.563464:0:23485:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399756.563473:0:23485:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399756.563498:0:23485:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23485:1832281081674688:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399756.565203:0:23485:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399756.568144:0:23485:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23485:1832281081674688:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399756.568177:0:23485:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399756.568183:0:23485:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399756.568185:0:23485:0:(obd_config.c:1460:class_process_config()) marker 103 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399756.568188:0:23485:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 159 count 156 00000020:01000000:2.0:1747399756.568463:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:2.0:1747399756.568478:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399756.568484:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.568492:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399756.568499:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399756.568501:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399756.568503:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399756.568525:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.568530:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.568536:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399756.568558:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674752:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399756.569084:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399756.571135:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674752:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399756.571157:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.571165:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399756.571222:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674816:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399756.571269:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399756.576740:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081674816:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399756.576772:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399756.576778:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.576786:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399756.869293:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399756.869366:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1747399756.869368:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:3.0:1747399756.869422:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089118080 00000100:00100000:3.0:1747399756.869464:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 3 00000100:00100000:3.0:1747399756.869469:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:26794:x1832281089118080:12345-192.168.204.160@tcp:104: 00010000:00010000:3.0:1747399756.869479:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399756.869539:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1747399756.869543:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:26794:x1832281089118080:12345-192.168.204.160@tcp:104: Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1747399756.869549:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 3 00010000:00010000:2.0:1747399756.869568:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399756.869572:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.869579:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b221c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399756.869581:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399756.869595:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089118016 00010000:00010000:2.0:1747399756.869598:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399756.869602:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399756.869605:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1747399756.869612:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 69 00000100:00100000:1.0:1747399756.869615:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26794:x1832281089118016:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399756.869620:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399756.869906:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399756.869911:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:26794:x1832281089118016:12345-192.168.204.160@tcp:104: Request processed in 294us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399756.869916:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 69 00010000:00010000:2.0:1747399756.869922:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.869927:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399756.869943:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.869947:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b221c0/0xd95e55596abded48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604fa9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399756.869957:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399756.869960:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399756.869960:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399756.869961:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399756.869962:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399756.869965:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399756.869972:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399756.869973:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081674880:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1747399756.869988:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399756.869992:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399756.869996:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399756.870007:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399756.870011:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399756.870030:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399756.870034:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abded4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf604fb0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399756.870046:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399756.870047:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399756.870048:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399756.870064:0:1862:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1747399756.870071:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081674944:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399756.877362:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081674880:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399756.877443:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081674944:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399757.553476:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399757.983488:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399757.983493:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 159 10000000:01000000:2.0:1747399757.983498:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399757.983530:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399757.983539:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399757.983556:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399757.983577:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675008:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399757.983635:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399757.988273:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675008:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399757.988293:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399757.988301:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399757.988407:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675072:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399757.988465:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399757.990827:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675072:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399757.990866:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675136:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399757.990920:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399757.992758:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675136:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399757.994695:0:23487:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23487:1832281081675200:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399757.995020:0:23487:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399758.000045:0:23487:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23487:1832281081675200:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399758.000077:0:23487:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399758.000085:0:23487:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399758.000087:0:23487:0:(obd_config.c:1460:class_process_config()) marker 105 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399758.000091:0:23487:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399758.000093:0:23487:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399758.000102:0:23487:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399758.000124:0:23487:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23487:1832281081675264:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399758.000188:0:23487:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399758.004483:0:23487:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23487:1832281081675264:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399758.004526:0:23487:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399758.004533:0:23487:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399758.004534:0:23487:0:(obd_config.c:1460:class_process_config()) marker 105 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399758.004538:0:23487:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 162 count 159 00000020:01000000:0.0:1747399758.005325:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:0.0:1747399758.005343:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399758.005348:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399758.005358:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399758.005365:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399758.005366:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399758.005368:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399758.005388:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399758.005399:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399758.005405:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399758.005421:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675328:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399758.005463:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753a80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399758.008906:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675328:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399758.008926:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399758.008935:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399758.009008:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675392:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399758.009357:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399758.011053:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675392:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399758.011079:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399758.011084:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399758.011091:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399758.396994:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399758.396998:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399758.397000:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399758.397002:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399758.397028:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081675520:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399758.397107:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399758.397112:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081675456:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399758.403040:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081675456:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399758.403057:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081675520:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399758.556920:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399759.417483:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399759.417531:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399759.417560:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089121280 00000100:00100000:0.0:1747399759.417587:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089121344 00000100:00100000:0.0:1747399759.417595:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 70 00000100:00100000:0.0:1747399759.417599:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:26889:x1832281089121280:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399759.417611:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399759.417669:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399759.417674:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:26889:x1832281089121280:12345-192.168.204.160@tcp:104: Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399759.417679:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 70 00000100:00100000:0.0:1747399759.417691:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 71 00000100:00100000:0.0:1747399759.417693:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:26889:x1832281089121344:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399759.417697:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417698:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399759.417707:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417714:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1b00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399759.417716:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417721:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399759.417725:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399759.417727:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1747399759.417729:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747399759.417734:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:26889:x1832281089121344:12345-192.168.204.160@tcp:104: Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399759.417739:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 71 00010000:00010000:2.0:1747399759.417755:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417759:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399759.417772:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417777:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1b00/0xd95e55596abded5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605027 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417791:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399759.417792:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417796:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399759.417797:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417801:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399759.417809:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399759.417812:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399759.417822:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417826:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399759.417830:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399759.417831:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399759.417834:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605020 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399759.417842:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399759.417843:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399759.417844:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399759.417856:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081675648:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399759.417901:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399759.417908:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081675584:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399759.422011:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081675584:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399759.422021:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081675648:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399759.557590:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399760.008172:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399760.008178:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 162 10000000:01000000:0.0:1747399760.008182:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399760.008219:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399760.008227:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399760.008236:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399760.008256:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399760.008875:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753e40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399760.013791:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399760.013814:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399760.013833:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399760.013898:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675776:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399760.015153:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399760.018774:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675776:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399760.018821:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675840:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399760.019222:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399760.024804:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081675840:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399760.026128:0:23502:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23502:1832281081675904:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399760.026361:0:23502:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399760.031464:0:23502:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23502:1832281081675904:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399760.031497:0:23502:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399760.031505:0:23502:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399760.031507:0:23502:0:(obd_config.c:1460:class_process_config()) marker 107 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399760.031511:0:23502:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399760.031514:0:23502:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399760.031523:0:23502:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399760.031548:0:23502:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23502:1832281081675968:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399760.031617:0:23502:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399760.036647:0:23502:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23502:1832281081675968:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399760.036682:0:23502:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399760.036687:0:23502:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399760.036689:0:23502:0:(obd_config.c:1460:class_process_config()) marker 107 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399760.036692:0:23502:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 165 count 162 00000020:01000000:2.0:1747399760.037052:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 162-164 (rc=0) 10000000:01000000:2.0:1747399760.037069:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399760.037075:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399760.037083:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399760.037090:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399760.037092:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399760.037094:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399760.037114:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399760.037119:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399760.037125:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399760.037148:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676032:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399760.037190:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399760.040447:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676032:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399760.040466:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399760.040475:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399760.040528:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676096:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399760.041644:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5dd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399760.044048:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676096:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399760.044081:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399760.044087:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399760.044095:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399760.560390:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399761.565480:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399761.948672:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399761.949180:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399761.949209:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089124544 00000100:00100000:0.0:1747399761.949231:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089124608 00000100:00100000:0.0:1747399761.949238:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 72 00000100:00100000:0.0:1747399761.949242:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:26963:x1832281089124544:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399761.949253:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399761.949905:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399761.949912:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:26963:x1832281089124544:12345-192.168.204.160@tcp:104: Request processed in 668us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399761.949927:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 72 00000100:00100000:0.0:1747399761.949940:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 73 00000100:00100000:0.0:1747399761.949944:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:26963:x1832281089124608:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399761.949949:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399761.949987:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399761.949991:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:26963:x1832281089124608:12345-192.168.204.160@tcp:104: Request processed in 47us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399761.949996:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 73 00010000:00010000:3.0:1747399761.950018:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399761.950023:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399761.950030:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399761.950032:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399761.950037:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399761.950041:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399761.950045:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399761.950061:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399761.950064:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399761.950069:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399761.950070:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1d40 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:3.0:1747399761.950073:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1747399761.950077:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399761.950081:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399761.950085:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399761.950086:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399761.950089:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399761.950090:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abded6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60503c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399761.950101:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399761.950106:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399761.950110:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399761.950113:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605035 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399761.950122:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399761.950123:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399761.950124:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399761.950128:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399761.950129:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399761.950130:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399761.950135:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081676160:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399761.950138:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081676224:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399761.953988:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081676224:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399761.954681:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081676160:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399762.567496:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399763.404448:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399763.404452:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399763.404454:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399763.404467:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399763.404492:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081676352:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399763.404570:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399763.404575:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081676288:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399763.409921:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081676288:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399763.409938:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081676352:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399763.570664:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399763.623416:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399763.623422:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 165 10000000:01000000:2.0:1747399763.623426:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399763.623460:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399763.623468:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399763.623476:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399763.623495:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676416:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399763.624509:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5db40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399763.631546:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676416:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399763.631567:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399763.631576:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399763.631647:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676480:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399763.631697:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5db40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399763.635272:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676480:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399763.635347:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676544:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399763.635412:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5db40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399763.645795:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676544:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399763.647066:0:23514:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23514:1832281081676608:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399763.647131:0:23514:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399763.650469:0:23514:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23514:1832281081676608:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399763.650505:0:23514:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399763.650513:0:23514:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399763.650515:0:23514:0:(obd_config.c:1460:class_process_config()) marker 109 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399763.650519:0:23514:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399763.650521:0:23514:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399763.650530:0:23514:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399763.650554:0:23514:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23514:1832281081676672:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399763.651210:0:23514:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399763.652810:0:23514:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23514:1832281081676672:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399763.652837:0:23514:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399763.652841:0:23514:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399763.652842:0:23514:0:(obd_config.c:1460:class_process_config()) marker 109 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399763.652845:0:23514:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 168 count 165 00000020:01000000:2.0:1747399763.653104:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 165-167 (rc=0) 10000000:01000000:2.0:1747399763.653122:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399763.653128:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399763.653138:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399763.653145:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399763.653147:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399763.653149:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399763.653168:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399763.653174:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399763.653180:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399763.653194:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676736:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399763.653652:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5db40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399763.660252:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676736:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399763.660283:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399763.660291:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399763.660370:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676800:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399763.660425:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399763.665889:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676800:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399763.665925:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399763.665930:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399763.665938:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399764.538530:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399764.538570:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399764.538601:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089127360 00000100:00100000:0.0:1747399764.538602:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089127424 00000100:00100000:1.0:1747399764.538628:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 74 00000100:00100000:1.0:1747399764.538633:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:27051:x1832281089127360:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399764.538644:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399764.538710:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399764.538714:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:27051:x1832281089127360:12345-192.168.204.160@tcp:104: Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399764.538720:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 74 00000100:00100000:1.0:1747399764.538732:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 75 00000100:00100000:1.0:1747399764.538734:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:27051:x1832281089127424:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399764.538738:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538740:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399764.538744:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538749:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399764.538752:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538756:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399764.538760:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399764.538763:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399764.538766:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399764.538770:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:27051:x1832281089127424:12345-192.168.204.160@tcp:104: Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399764.538774:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 75 00010000:00010000:2.0:1747399764.538787:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538791:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399764.538802:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538806:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605115 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538827:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399764.538828:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538831:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6d00 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:3.0:1747399764.538849:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1747399764.538859:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399764.538861:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081676864:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399764.538868:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399764.538872:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399764.538875:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399764.538884:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399764.538888:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399764.538891:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399764.538894:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1747399764.538894:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60510e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399764.538898:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081676928:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399764.538901:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399764.538902:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399764.538903:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399764.545786:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081676864:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399764.545808:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081676928:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399764.572016:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399765.576098:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399765.756414:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399765.756419:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 168 10000000:01000000:1.0:1747399765.756424:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399765.756459:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399765.756468:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399765.756475:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399765.756493:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676992:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399765.756559:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ef00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399765.761605:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081676992:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399765.761625:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399765.761634:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399765.761692:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677056:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399765.761741:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399765.763453:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677056:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399765.763496:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677120:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399765.763553:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399765.766544:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677120:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399765.770408:0:23545:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23545:1832281081677184:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399765.770486:0:23545:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747399765.776205:0:23545:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23545:1832281081677184:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399765.776241:0:23545:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399765.776249:0:23545:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399765.776251:0:23545:0:(obd_config.c:1460:class_process_config()) marker 111 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399765.776256:0:23545:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399765.776258:0:23545:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399765.776268:0:23545:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000020:01000000:3.0:1747399765.776271:0:23545:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399765.776272:0:23545:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399765.776273:0:23545:0:(obd_config.c:1460:class_process_config()) marker 111 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399765.776274:0:23545:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399765.776276:0:23545:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399765.776276:0:23545:0:(obd_config.c:1460:class_process_config()) marker 113 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399765.776278:0:23545:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399765.776279:0:23545:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399765.776281:0:23545:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747399765.776307:0:23545:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23545:1832281081677248:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399765.776873:0:23545:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747399765.785351:0:23545:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23545:1832281081677248:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399765.785385:0:23545:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399765.785392:0:23545:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399765.785393:0:23545:0:(obd_config.c:1460:class_process_config()) marker 113 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399765.785396:0:23545:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 174 count 171 00000020:01000000:2.0:1747399765.786553:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 168-173 (rc=0) 10000000:01000000:2.0:1747399765.786571:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399765.786577:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399765.786586:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399765.786594:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399765.786596:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399765.786597:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399765.786620:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399765.786625:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399765.786632:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399765.786648:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399765.786702:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399765.788893:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399765.788911:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399765.788926:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399765.788975:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677376:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399765.789018:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399765.790681:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677376:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399765.790713:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399765.790718:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399765.790725:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.576775:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399766.754266:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399766.754357:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399766.754358:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399766.754375:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089130176 00000100:00100000:1.0:1747399766.754409:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 76 00000100:00100000:1.0:1747399766.754419:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:27193:x1832281089130176:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399766.754430:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399766.754478:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399766.754482:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:27193:x1832281089130176:12345-192.168.204.160@tcp:104: Request processed in 63us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399766.754487:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 76 00010000:00010000:2.0:1747399766.754702:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399766.754706:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.754712:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6d00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399766.754714:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.754736:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399766.754741:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399766.754749:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399766.754846:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.754852:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399766.757122:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.757143:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abded87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605193 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399766.757340:0:4657:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089130240 00000100:00100000:3.0:1747399766.757378:0:4657:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 4 00000100:00100000:3.0:1747399766.757382:0:4657:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:27193:x1832281089130240:12345-192.168.204.160@tcp:104: 00010000:00010000:3.0:1747399766.757402:0:4657:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.757892:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399766.757894:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399766.757896:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399766.758118:0:4657:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1747399766.758124:0:4657:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:27193:x1832281089130240:12345-192.168.204.160@tcp:104: Request processed in 741us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1747399766.758132:0:4657:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 4 00000100:00100000:3.0:1747399766.758160:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081677440:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399766.758277:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399766.758281:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.758287:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a400 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399766.758290:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.758296:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399766.758301:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399766.758305:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399766.758348:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.758353:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399766.758362:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.758372:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abded80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60518c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399766.758383:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399766.758384:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399766.758385:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399766.758390:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399766.758397:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081677504:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399766.768055:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081677504:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399766.768066:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081677440:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399767.578279:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399767.687438:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399767.687444:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 174 10000000:01000000:2.0:1747399767.687448:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399767.687491:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.687499:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.687507:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399767.687525:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677568:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399767.687591:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5de40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399767.692844:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677568:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399767.692878:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.692887:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399767.692948:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677632:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399767.693002:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5de40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399767.696530:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677632:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399767.696584:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677696:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399767.696651:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5de40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399767.702442:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677696:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399767.703893:0:23563:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23563:1832281081677760:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399767.703972:0:23563:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b3c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399767.711907:0:23563:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23563:1832281081677760:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399767.711938:0:23563:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399767.711944:0:23563:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399767.711946:0:23563:0:(obd_config.c:1460:class_process_config()) marker 115 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399767.711950:0:23563:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399767.711952:0:23563:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399767.711961:0:23563:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000020:01000000:3.0:1747399767.711963:0:23563:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399767.711965:0:23563:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399767.711965:0:23563:0:(obd_config.c:1460:class_process_config()) marker 115 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000100:00100000:3.0:1747399767.711988:0:23563:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23563:1832281081677824:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399767.712040:0:23563:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b3c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399767.713860:0:23563:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23563:1832281081677824:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399767.713890:0:23563:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399767.713896:0:23563:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399767.713904:0:23563:0:(obd_config.c:1460:class_process_config()) marker 117 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399767.713908:0:23563:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399767.713911:0:23563:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399767.713917:0:23563:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:3.0:1747399767.713937:0:23563:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23563:1832281081677888:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399767.713985:0:23563:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b3c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399767.719531:0:23563:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23563:1832281081677888:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399767.719564:0:23563:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399767.719570:0:23563:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399767.719572:0:23563:0:(obd_config.c:1460:class_process_config()) marker 117 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399767.719575:0:23563:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 181 count 177 00000020:01000000:2.0:1747399767.719715:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 174-180 (rc=0) 10000000:01000000:2.0:1747399767.719732:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399767.719738:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.719746:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399767.719753:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399767.719755:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399767.719757:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399767.719791:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.719796:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.719810:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399767.719826:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677952:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399767.719867:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5de40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399767.725581:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081677952:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399767.725602:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.725611:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399767.725670:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678016:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399767.725727:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5de40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399767.729937:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678016:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399767.729975:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399767.729981:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399767.730079:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399768.411583:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399768.411588:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399768.411590:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399768.411602:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399768.411634:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081678144:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399768.411973:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399768.411979:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081678080:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399768.417450:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081678080:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399768.417640:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081678144:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399768.581226:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399769.583531:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399770.585527:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399770.684521:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399770.684579:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399770.684627:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089134144 00000100:00100000:0.0:1747399770.684661:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089134208 00000100:00100000:0.0:1747399770.684670:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 77 00000100:00100000:0.0:1747399770.684675:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:27483:x1832281089134144:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399770.684689:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399770.684775:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399770.684780:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:27483:x1832281089134144:12345-192.168.204.160@tcp:104: Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399770.684798:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 77 00000100:00100000:0.0:1747399770.684812:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 78 00000100:00100000:0.0:1747399770.684815:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:27483:x1832281089134208:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399770.684821:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399770.684862:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399770.684866:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:27483:x1832281089134208:12345-192.168.204.160@tcp:104: Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399770.684871:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 78 00010000:00010000:2.0:1747399770.685136:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399770.685141:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685148:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399770.685151:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685157:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399770.685161:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399770.685165:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399770.685200:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685206:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399770.685229:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685234:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abded95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6051af expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685260:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399770.685262:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685266:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399770.685267:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685271:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399770.685275:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399770.685278:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399770.685289:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685293:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399770.685296:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685300:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abded8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6051a8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399770.685340:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399770.685341:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399770.685388:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399770.685404:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081678208:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399770.685462:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399770.685467:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081678272:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399770.686076:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399770.688500:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081678272:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399770.688514:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081678208:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399771.590135:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399772.359410:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399772.359416:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 181 10000000:01000000:0.0:1747399772.359420:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399772.359453:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399772.359461:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399772.359469:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399772.359489:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678336:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399772.359554:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67533c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399772.365940:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678336:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399772.365969:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399772.365982:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399772.366065:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678400:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399772.366135:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399772.370260:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678400:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399772.370373:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678464:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399772.372166:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399772.377281:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678464:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399772.378238:0:23615:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23615:1832281081678528:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399772.378358:0:23615:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399772.381723:0:23615:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23615:1832281081678528:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399772.381771:0:23615:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399772.381779:0:23615:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399772.381781:0:23615:0:(obd_config.c:1460:class_process_config()) marker 119 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399772.381786:0:23615:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399772.381797:0:23615:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399772.381873:0:23615:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23615:1832281081678592:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399772.382400:0:23615:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399772.385682:0:23615:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:23615:1832281081678592:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399772.385738:0:23615:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399772.385745:0:23615:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399772.385746:0:23615:0:(obd_config.c:1460:class_process_config()) marker 119 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399772.385750:0:23615:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 184 count 180 00000020:01000000:2.0:1747399772.385982:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 181-183 (rc=0) 10000000:01000000:2.0:1747399772.386004:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399772.386011:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399772.386021:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399772.386029:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399772.386031:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399772.386033:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399772.386058:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399772.386073:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399772.386080:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399772.386097:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678656:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399772.386484:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399772.389566:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678656:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399772.389596:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399772.389607:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399772.390285:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678720:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399772.390366:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5da80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399772.392685:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081678720:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399772.392745:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399772.392752:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399772.392762:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399772.591719:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1747399773.419464:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399773.419468:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747399773.419469:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399773.419476:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747399773.419496:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081678848:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399773.419559:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1747399773.419564:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081678784:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399773.423057:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081678784:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399773.423071:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081678848:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399773.596578:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399774.603794:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399775.608442:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399776.020723:0:24245:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399776.020726:0:24245:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 4a: pool_destroy: non-existant pool ==== 08:49:35 (1747399775) 00010000:00010000:2.0:1747399776.607442:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399777.612766:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399778.429392:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081678912:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00080000:2.0:1747399778.429505:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399778.429508:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399778.429510:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399778.429511:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399778.429535:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081678976:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399778.432469:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081678912:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399778.433103:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081678976:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399778.615425:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1747399779.589959:0:24877:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1747399779.589963:0:24877:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 4b: pool_destroy: non-existant fs-name ========================================================== 08:49:38 (1747399778) 00010000:00010000:3.0:1747399779.618399:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399780.620500:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399781.623609:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399782.626335:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399783.046699:0:25507:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399783.046703:0:25507:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 4c: pool_destroy: non-empty pool ======= 08:49:42 (1747399782) 00000100:00080000:2.0:1747399783.436095:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399783.436099:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399783.436101:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399783.436103:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399783.436124:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081679104:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399783.436632:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399783.436638:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679040:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399783.444198:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679040:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399783.444218:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081679104:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399783.525072:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399783.525124:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399783.525169:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089137856 00000100:00100000:0.0:1747399783.525195:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089137920 00000100:00100000:0.0:1747399783.525204:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 79 00000100:00100000:0.0:1747399783.525208:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:28549:x1832281089137856:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399783.525219:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399783.525283:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399783.525287:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:28549:x1832281089137856:12345-192.168.204.160@tcp:104: Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399783.525293:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 79 00000100:00100000:0.0:1747399783.525305:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 80 00000100:00100000:0.0:1747399783.525308:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:28549:x1832281089137920:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399783.525338:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399783.525342:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399783.525347:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399783.525348:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399783.525351:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399783.525357:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399783.525370:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399783.525374:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399783.526256:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399783.526262:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:28549:x1832281089137920:12345-192.168.204.160@tcp:104: Request processed in 952us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399783.526267:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 80 00010000:00010000:3.0:1747399783.526373:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399783.526377:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399783.526392:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1d40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399783.526393:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399783.526393:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399783.526398:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399783.526399:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1747399783.526402:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399783.526406:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399783.526413:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399783.526418:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdeda3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605288 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399783.526421:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399783.526425:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399783.526429:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399783.526429:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399783.526430:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399783.526431:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399783.526433:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abded9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605281 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399783.526444:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679232:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399783.526446:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399783.526447:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399783.526448:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399783.526455:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081679168:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399783.534353:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081679168:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399783.534448:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679232:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399783.629900:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399784.631712:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399784.785136:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399784.785142:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 184 10000000:01000000:0.0:1747399784.785147:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399784.785185:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399784.785193:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399784.785201:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399784.785222:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399784.785297:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67539c0 going to sleep for 6 seconds 00000100:00100000:0.0:1747399784.790600:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1747399784.790629:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399784.790640:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399784.790717:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679360:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747399784.790794:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67539c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399784.794297:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679360:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399784.794406:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679424:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399784.794511:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399784.796622:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679424:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399784.797469:0:25538:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25538:1832281081679488:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399784.797555:0:25538:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399784.800639:0:25538:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25538:1832281081679488:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399784.800686:0:25538:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399784.800696:0:25538:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399784.800697:0:25538:0:(obd_config.c:1460:class_process_config()) marker 121 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747399784.800703:0:25538:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399784.800705:0:25538:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399784.800727:0:25538:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747399784.800764:0:25538:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25538:1832281081679552:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399784.801333:0:25538:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399784.804154:0:25538:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25538:1832281081679552:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399784.804206:0:25538:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399784.804212:0:25538:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399784.804214:0:25538:0:(obd_config.c:1460:class_process_config()) marker 121 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747399784.804219:0:25538:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 187 count 183 00000020:01000000:2.0:1747399784.804425:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1747399784.804450:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399784.804478:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399784.804488:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399784.804496:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399784.804499:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399784.804501:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399784.804533:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399784.804539:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399784.804547:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399784.804566:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679616:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399784.804869:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399784.806474:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679616:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399784.806498:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399784.806659:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399784.806729:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679680:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399784.806787:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399784.808137:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679680:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399784.808184:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399784.808189:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399784.808196:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399785.633583:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399786.624738:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399786.625446:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399786.625663:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089140672 00000100:00100000:1.0:1747399786.625697:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089140736 00000100:00100000:1.0:1747399786.625708:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 81 00000100:00100000:1.0:1747399786.625713:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:28753:x1832281089140672:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399786.625727:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399786.626375:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399786.626381:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:28753:x1832281089140672:12345-192.168.204.160@tcp:104: Request processed in 667us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399786.626388:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 81 00000100:00100000:1.0:1747399786.626403:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 82 00000100:00100000:1.0:1747399786.626407:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:28753:x1832281089140736:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399786.626432:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399786.626463:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399786.626467:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:28753:x1832281089140736:12345-192.168.204.160@tcp:104: Request processed in 60us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399786.626471:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 82 00010000:00010000:2.0:1747399786.626851:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399786.626860:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.626869:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399786.626871:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.626878:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399786.626881:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399786.626885:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399786.626926:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.626930:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399786.626945:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.626949:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6880/0xd95e55596abdedb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6052ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.626976:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399786.626978:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.626982:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1d40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399786.626983:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.626988:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399786.626992:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399786.626995:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399786.627004:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.627008:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399786.627012:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.627015:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1d40/0xd95e55596abdedaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6052f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.627024:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399786.627025:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399786.627026:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399786.627050:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679808:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399786.627106:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399786.627115:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679744:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399786.627192:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399786.630082:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679744:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399786.630899:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081679808:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399786.636406:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399786.716412:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399786.716426:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 187 10000000:01000000:2.0:1747399786.716431:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399786.716465:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.716472:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.716479:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399786.716498:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399786.716568:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399786.726704:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399786.726734:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.726746:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399786.726820:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679936:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399786.726873:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399786.733400:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081679936:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399786.733506:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680000:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399786.733591:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399786.735815:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680000:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399786.736439:0:25580:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25580:1832281081680064:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399786.736517:0:25580:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399786.755477:0:25580:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25580:1832281081680064:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399786.755527:0:25580:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399786.755537:0:25580:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399786.755539:0:25580:0:(obd_config.c:1460:class_process_config()) marker 123 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399786.755544:0:25580:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399786.755546:0:25580:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399786.755567:0:25580:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399786.755601:0:25580:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25580:1832281081680128:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399786.757234:0:25580:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399786.760354:0:25580:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25580:1832281081680128:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399786.760399:0:25580:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399786.760407:0:25580:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399786.760409:0:25580:0:(obd_config.c:1460:class_process_config()) marker 123 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399786.760412:0:25580:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 190 count 186 00000020:01000000:2.0:1747399786.760661:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:2.0:1747399786.760682:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399786.760688:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.760698:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399786.760706:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399786.760708:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399786.760711:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399786.760740:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.760746:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.760754:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399786.760773:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680192:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399786.760832:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399786.764694:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680192:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399786.764721:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.764742:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399786.764816:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680256:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399786.764875:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399786.767415:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680256:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399786.767471:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399786.767478:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399786.767489:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399787.638011:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399788.445517:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399788.445523:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399788.445525:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399788.445527:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399788.445562:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081680384:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399788.445662:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399788.445669:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081680320:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399788.453847:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081680320:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399788.453870:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081680384:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399788.639659:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399789.641487:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399790.644210:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399791.464277:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399791.464388:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399791.464523:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399791.464547:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089144576 00000100:00100000:1.0:1747399791.464592:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 83 00000100:00100000:1.0:1747399791.464599:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:29101:x1832281089144576:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399791.464620:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399791.464816:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089144640 00000100:00100000:3.0:1747399791.464843:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 5 00000100:00100000:3.0:1747399791.464847:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+4:29101:x1832281089144640:12345-192.168.204.160@tcp:104: 00010000:00010000:3.0:1747399791.464852:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399791.464890:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399791.464896:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:29101:x1832281089144576:12345-192.168.204.160@tcp:104: Request processed in 296us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399791.464902:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 83 00010000:00010000:3.0:1747399791.464909:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1747399791.464913:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:29101:x1832281089144640:12345-192.168.204.160@tcp:104: Request processed in 66us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1747399791.464918:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 5 00010000:00010000:3.0:1747399791.464934:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399791.464939:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399791.464945:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f61c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399791.464948:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399791.464954:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399791.464971:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399791.464975:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399791.465007:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399791.465013:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399791.465105:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399791.465110:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399791.465116:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399791.465117:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399791.465122:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399791.465127:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399791.465130:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399791.465148:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399791.465153:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399791.465549:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399791.465555:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399791.465555:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdedb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60530d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399791.465561:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605314 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399791.465573:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399791.465574:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399791.465575:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399791.465576:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399791.465577:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399791.465578:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399791.465590:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081680448:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399791.465591:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081680512:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399791.468612:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081680512:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399791.468810:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081680448:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399791.645736:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399792.647567:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399792.707515:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399792.707524:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 190 10000000:01000000:1.0:1747399792.707531:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399792.707580:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399792.707591:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399792.707602:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399792.707650:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399792.707746:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399792.714732:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399792.714762:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399792.714774:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399792.714847:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399792.714910:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399792.716904:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399792.716967:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680704:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399792.717043:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399792.719850:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680704:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399792.721402:0:25645:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25645:1832281081680768:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399792.721491:0:25645:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399792.724490:0:25645:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25645:1832281081680768:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399792.724540:0:25645:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399792.724547:0:25645:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399792.724549:0:25645:0:(obd_config.c:1460:class_process_config()) marker 125 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:1.0:1747399792.724554:0:25645:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399792.724564:0:25645:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1747399792.724576:0:25645:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:1.0:1747399792.724607:0:25645:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25645:1832281081680832:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399792.724709:0:25645:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399792.726755:0:25645:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25645:1832281081680832:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399792.726801:0:25645:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399792.726807:0:25645:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399792.726809:0:25645:0:(obd_config.c:1460:class_process_config()) marker 125 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:1.0:1747399792.726812:0:25645:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 193 count 189 00000020:01000000:2.0:1747399792.727580:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:2.0:1747399792.727603:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399792.727611:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399792.727622:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399792.727631:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399792.727633:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399792.727635:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399792.727667:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399792.727673:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399792.727681:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399792.727905:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680896:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399792.727985:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5db40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399792.730577:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680896:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399792.730607:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399792.730618:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399792.730706:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680960:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399792.730767:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5db40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399792.733027:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081680960:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399792.733075:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399792.733084:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399792.733094:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399793.451514:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399793.451521:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399793.451524:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399793.451526:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399793.451559:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081681088:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399793.451660:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399793.451665:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081681024:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399793.459228:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081681024:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399793.459244:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081681088:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399793.649982:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399794.366096:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399794.366155:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399794.366204:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089147648 00000100:00100000:0.0:1747399794.366236:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089147712 00000100:00100000:0.0:1747399794.366245:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 84 00000100:00100000:0.0:1747399794.366250:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:29243:x1832281089147648:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399794.366264:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399794.366376:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399794.366381:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:29243:x1832281089147648:12345-192.168.204.160@tcp:104: Request processed in 131us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399794.366387:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 84 00000100:00100000:0.0:1747399794.366402:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 85 00000100:00100000:0.0:1747399794.366405:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:29243:x1832281089147712:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399794.366410:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399794.366444:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399794.366448:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:29243:x1832281089147712:12345-192.168.204.160@tcp:104: Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399794.366452:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 85 00010000:00010000:3.0:1747399794.366501:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399794.366507:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366513:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f61c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399794.366517:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366524:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399794.366535:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399794.366539:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399794.366578:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366583:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399794.366598:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366602:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f61c0/0xd95e55596abdedcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60538b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366625:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399794.366626:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366629:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a400 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399794.366631:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366634:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399794.366637:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399794.366640:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399794.366650:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366660:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399794.366663:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366667:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdedc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605384 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399794.366680:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399794.366681:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399794.366682:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399794.366685:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399794.366695:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081681152:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399794.366782:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081681216:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399794.371534:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081681152:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399794.371697:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081681216:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399794.651652:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399795.657375:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399796.109412:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399796.109417:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 193 10000000:01000000:1.0:1747399796.109422:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399796.109491:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399796.109500:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399796.109508:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399796.109528:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681280:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399796.109607:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ef00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399796.111988:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681280:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399796.112006:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399796.112014:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399796.112083:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681344:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399796.112282:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ef00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399796.113558:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681344:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399796.113590:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681408:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399796.113640:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ef00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399796.115944:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681408:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399796.116233:0:25684:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25684:1832281081681472:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399796.116300:0:25684:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ef00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399796.120157:0:25684:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25684:1832281081681472:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399796.120193:0:25684:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399796.120200:0:25684:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399796.120202:0:25684:0:(obd_config.c:1460:class_process_config()) marker 127 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:1.0:1747399796.120206:0:25684:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399796.120208:0:25684:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1747399796.120305:0:25684:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25684:1832281081681536:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399796.120391:0:25684:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ef00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399796.124427:0:25684:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:25684:1832281081681536:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399796.124459:0:25684:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399796.124464:0:25684:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399796.124465:0:25684:0:(obd_config.c:1460:class_process_config()) marker 127 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:1.0:1747399796.124468:0:25684:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 196 count 192 00000020:01000000:2.0:1747399796.124590:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:2.0:1747399796.124609:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399796.124614:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399796.124622:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399796.124629:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399796.124631:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399796.124632:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399796.124651:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399796.124655:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399796.124661:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399796.124673:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681600:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399796.124719:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399796.126282:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681600:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399796.126296:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399796.126304:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399796.126372:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681664:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399796.126411:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dc5d180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399796.128379:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681664:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399796.128407:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399796.128412:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399796.128420:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399796.655512:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399797.657851:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1747399798.459569:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399798.459573:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1747399798.459574:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399798.459576:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399798.459608:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081681728:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399798.459667:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399798.459671:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081681792:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399798.464886:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081681792:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399798.464899:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081681728:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399798.659556:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399799.588918:0:26303:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399799.588924:0:26303:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 5a: lfs pool_list from client ========== 08:49:59 (1747399799) 00010000:00010000:2.0:1747399799.662999:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399800.663537:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399800.962920:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399800.962967:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399800.962997:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089150464 00000100:00100000:0.0:1747399800.963020:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089150528 00000100:00100000:0.0:1747399800.963028:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 86 00000100:00100000:0.0:1747399800.963032:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:29803:x1832281089150464:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399800.963044:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399800.963103:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399800.963108:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:29803:x1832281089150464:12345-192.168.204.160@tcp:104: Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399800.963113:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 86 00000100:00100000:0.0:1747399800.963126:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 87 00000100:00100000:0.0:1747399800.963129:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:29803:x1832281089150528:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399800.963133:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399800.963188:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399800.963192:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:29803:x1832281089150528:12345-192.168.204.160@tcp:104: Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399800.963197:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 87 00010000:00010000:2.0:1747399800.964044:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399800.964049:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964055:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6400 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399800.964057:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964062:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399800.964066:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399800.964070:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399800.964111:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964116:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399800.964131:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964134:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdeddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605464 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964180:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399800.964182:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964186:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399800.964187:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964190:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399800.964192:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1747399800.964194:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399800.964197:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1747399800.964206:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081681856:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399800.964208:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964211:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399800.964215:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964218:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdedd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60545d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399800.964226:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399800.964227:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399800.964228:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399800.964242:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081681920:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399800.968915:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081681856:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399800.970222:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081681920:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399801.666209:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399802.632418:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399802.632424:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 196 10000000:01000000:3.0:1747399802.632428:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399802.632463:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.632471:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.632479:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399802.632498:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681984:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399802.632565:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399802.636117:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081681984:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399802.636192:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.636208:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399802.636291:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682048:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399802.636701:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399802.638514:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682048:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399802.638571:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682112:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399802.638851:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399802.640903:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682112:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399802.646604:0:26363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26363:1832281081682176:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399802.646715:0:26363:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399802.651530:0:26363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26363:1832281081682176:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399802.651596:0:26363:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399802.651607:0:26363:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399802.651609:0:26363:0:(obd_config.c:1460:class_process_config()) marker 129 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:1.0:1747399802.651615:0:26363:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399802.651617:0:26363:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1747399802.651639:0:26363:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:1.0:1747399802.651677:0:26363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26363:1832281081682240:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399802.651768:0:26363:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e3c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399802.654338:0:26363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26363:1832281081682240:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399802.654389:0:26363:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399802.654396:0:26363:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399802.654398:0:26363:0:(obd_config.c:1460:class_process_config()) marker 129 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:1.0:1747399802.654402:0:26363:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 199 count 195 00000020:01000000:3.0:1747399802.654573:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 196-198 (rc=0) 10000000:01000000:3.0:1747399802.654595:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1747399802.654603:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.654613:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399802.654621:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1747399802.654624:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:3.0:1747399802.654626:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1747399802.654656:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.654662:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.654681:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399802.654699:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682304:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399802.654760:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399802.656803:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682304:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399802.656832:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.656843:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399802.656920:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682368:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399802.656984:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399802.660360:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682368:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399802.660406:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399802.660415:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.660426:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399802.668615:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1747399803.467669:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399803.467675:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1747399803.467693:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399803.467695:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399803.467738:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081682496:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399803.467841:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399803.467847:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081682432:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399803.472904:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081682432:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399803.478393:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081682496:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399803.672480:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399804.132948:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399804.132990:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399804.133003:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089153728 00000100:00100000:0.0:1747399804.133007:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089153792 00000100:00100000:1.0:1747399804.133029:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 88 00000100:00100000:1.0:1747399804.133033:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:29993:x1832281089153728:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399804.133044:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399804.133138:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399804.133143:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:29993:x1832281089153728:12345-192.168.204.160@tcp:104: Request processed in 109us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399804.133148:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 88 00000100:00100000:1.0:1747399804.133169:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 89 00000100:00100000:1.0:1747399804.133172:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:29993:x1832281089153792:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399804.133177:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399804.133207:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399804.133211:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:29993:x1832281089153792:12345-192.168.204.160@tcp:104: Request processed in 39us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399804.133215:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 89 00010000:00010000:2.0:1747399804.133271:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399804.133276:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.133281:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b22640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399804.133284:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.133289:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399804.133294:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399804.133298:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399804.133348:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.133352:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399804.133365:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.133369:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b22640/0xd95e55596abdede9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6054db expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.133393:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399804.133394:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.133398:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b22400 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:3.0:1747399804.133497:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399804.133524:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399804.133629:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081682560:192.168.204.160@tcp:103:ldlm_bl_01.0 10000000:00010000:2.0:1747399804.134270:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.134277:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399804.134282:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399804.134286:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399804.134302:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.134306:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399804.134338:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.134343:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b22400/0xd95e55596abdede2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6054d4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399804.134365:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399804.134366:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399804.134368:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399804.134384:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081682624:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399804.138791:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081682624:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399804.138801:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081682560:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399804.673711:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399805.405451:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399805.405456:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 199 10000000:01000000:0.0:1747399805.405461:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399805.405506:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399805.405514:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399805.405523:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399805.405543:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682688:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399805.406451:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753c00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399805.410941:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682688:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399805.410963:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399805.410980:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399805.411038:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682752:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399805.411118:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399805.419894:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682752:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399805.419944:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682816:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399805.420017:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399805.426148:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081682816:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399805.427051:0:26403:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26403:1832281081682880:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399805.427175:0:26403:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399805.430802:0:26403:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26403:1832281081682880:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399805.430837:0:26403:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399805.430843:0:26403:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399805.430845:0:26403:0:(obd_config.c:1460:class_process_config()) marker 131 (0x1) lustre-clilov new lustre.testpool2 00000020:01000000:3.0:1747399805.430850:0:26403:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399805.430852:0:26403:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399805.430866:0:26403:0:(lov_pool.c:313:lov_pool_new()) testpool2 is pool #2 00000100:00100000:3.0:1747399805.430891:0:26403:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26403:1832281081682944:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399805.430948:0:26403:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399805.435269:0:26403:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26403:1832281081682944:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399805.435368:0:26403:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399805.435374:0:26403:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399805.435376:0:26403:0:(obd_config.c:1460:class_process_config()) marker 131 (0x2) lustre-clilov new lustre.testpool2 00000040:00080000:3.0:1747399805.435380:0:26403:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 202 count 198 00000020:01000000:2.0:1747399805.435999:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 199-201 (rc=0) 10000000:01000000:2.0:1747399805.436018:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399805.436024:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399805.436033:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399805.436041:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399805.436043:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399805.436045:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399805.436078:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399805.436084:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399805.436090:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399805.436113:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683008:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399805.436174:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399805.438210:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683008:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399805.438231:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399805.438241:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399805.438294:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683072:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399805.438365:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399805.440600:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683072:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399805.440633:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399805.440639:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399805.440647:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399805.675606:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399806.678375:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399807.285557:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399807.285603:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399807.286164:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399807.286179:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089156544 00000100:00100000:1.0:1747399807.286219:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 90 00000100:00100000:1.0:1747399807.286224:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30174:x1832281089156544:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399807.286233:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399807.286284:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399807.286287:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30174:x1832281089156544:12345-192.168.204.160@tcp:104: Request processed in 64us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399807.286292:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 90 00000100:00100000:3.0:1747399807.286470:0:4657:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1747399807.286480:0:4657:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089156608 00000100:00100000:3.0:1747399807.286499:0:4657:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 6 00000100:00100000:3.0:1747399807.286502:0:4657:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b65ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:30174:x1832281089156608:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399807.286505:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399807.286507:0:4657:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399807.286509:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399807.286515:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6400 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399807.286518:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399807.286528:0:4657:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1747399807.286531:0:4657:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b65ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:30174:x1832281089156608:12345-192.168.204.160@tcp:104: Request processed in 29us (929us total) trans 0 rc 0/0 00010000:00010000:2.0:1747399807.286531:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399807.286535:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399807.286536:0:4657:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 6 10000000:01000000:2.0:1747399807.286539:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399807.286563:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399807.286564:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399807.286565:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399807.286568:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399807.286570:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f1f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399807.286572:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399807.286575:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399807.286579:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399807.286579:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399807.286583:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6400/0xd95e55596abdedf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605552 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399807.286590:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399807.286595:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399807.286595:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399807.286597:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399807.286600:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399807.286604:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399807.286608:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399807.286611:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f1f80/0xd95e55596abdedf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60554b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399807.286614:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081683136:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399807.286625:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399807.286626:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399807.286627:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399807.286646:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399807.286650:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081683200:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399807.292128:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081683200:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399807.292153:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081683136:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399807.679716:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1747399808.475732:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399808.475736:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1747399808.475738:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399808.475740:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399808.475766:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081683328:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399808.475844:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399808.475850:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081683264:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399808.481423:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081683264:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399808.481440:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081683328:192.168.204.160@tcp:400:kworker/u8:3.0 10000000:01000000:2.0:1747399808.540420:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399808.540439:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 202 10000000:01000000:2.0:1747399808.540443:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399808.540481:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.540489:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.540496:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399808.540518:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399808.540601:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399808.544242:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399808.544263:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.544273:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399808.544354:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683456:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399808.544411:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399808.547372:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683456:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399808.547433:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683520:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399808.547512:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399808.556975:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683520:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399808.559099:0:26443:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26443:1832281081683584:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399808.559190:0:26443:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399808.576936:0:26443:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26443:1832281081683584:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399808.576990:0:26443:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399808.576998:0:26443:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399808.576999:0:26443:0:(obd_config.c:1460:class_process_config()) marker 133 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399808.577003:0:26443:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399808.577005:0:26443:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399808.577027:0:26443:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000020:01000000:3.0:1747399808.577031:0:26443:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399808.577033:0:26443:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399808.577034:0:26443:0:(obd_config.c:1460:class_process_config()) marker 133 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399808.577035:0:26443:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399808.577037:0:26443:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399808.577038:0:26443:0:(obd_config.c:1460:class_process_config()) marker 135 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399808.577039:0:26443:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399808.577041:0:26443:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399808.577043:0:26443:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747399808.577071:0:26443:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26443:1832281081683648:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399808.577141:0:26443:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399808.582912:0:26443:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26443:1832281081683648:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399808.582957:0:26443:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399808.582964:0:26443:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399808.582966:0:26443:0:(obd_config.c:1460:class_process_config()) marker 135 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399808.582969:0:26443:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 208 count 204 00000020:01000000:2.0:1747399808.583348:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 202-207 (rc=0) 10000000:01000000:2.0:1747399808.583382:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399808.583390:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.583399:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399808.583408:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399808.583410:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399808.583412:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399808.583441:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.583446:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.583453:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399808.583470:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399808.583873:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399808.591818:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683712:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399808.591840:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.591849:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399808.591912:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683776:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399808.591954:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399808.595616:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081683776:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399808.595657:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399808.595665:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.595673:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399808.681585:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399809.683973:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1747399809.741009:0:26459:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399809.741377:0:26459:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1747399809.741387:0:26459:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:2.0:1747399809.741424:0:26459:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.741431:0:26459:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.741437:0:26459:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399809.741457:0:26459:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26459:1832281081683840:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399809.743593:0:26459:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 43 seconds 00000100:00100000:3.0:1747399809.748256:0:26459:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26459:1832281081683840:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399809.748272:0:26459:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748286:0:26459:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748294:0:26459:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748300:0:26459:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748324:0:26459:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748329:0:26459:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748334:0:26459:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399809.748340:0:26459:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800b3aacc00 x1832281081683840/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/688 e 0 to 0 dl 1747399853 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1747399809.748348:0:26459:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748355:0:26459:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1747399809.748373:0:26459:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 10752 00000080:00010000:3.0:1747399809.748377:0:26459:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdee0c 00000080:00010000:3.0:1747399809.748381:0:26459:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399809.748383:0:26459:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdee0c from it ffff8800a9a27cf8 00010000:00010000:3.0:1747399809.748388:0:26459:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748392:0:26459:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.748824:0:26459:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399809.748834:0:26459:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399809.748840:0:26459:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748847:0:26459:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399809.748853:0:26459:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399809.748855:0:26459:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdee0c 00000080:00010000:3.0:1747399809.748857:0:26459:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdee0c from it ffff8800a9a27cf8 00010000:00010000:3.0:1747399809.748859:0:26459:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.748863:0:26459:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.749466:0:26459:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399809.749472:0:26459:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399809.749477:0:26459:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.749746:0:26459:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399809.749762:0:26459:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399809.749763:0:26459:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399809.749766:0:26459:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27b80 00010000:00010000:3.0:1747399809.749768:0:26459:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.749772:0:26459:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.749779:0:26459:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 44 00000080:00200000:3.0:1747399809.749785:0:26459:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), flags 504000 00000080:00200000:3.0:1747399809.749802:0:26459:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), cmd=0x8080667f 00000080:00200000:3.0:1747399809.749808:0:26459:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00200000:2.0:1747399809.758003:0:26460:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399809.758023:0:26460:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399809.758035:0:26460:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758046:0:26460:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399809.758061:0:26460:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399809.758063:0:26460:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399809.758068:0:26460:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b6717e00 00010000:00010000:2.0:1747399809.758070:0:26460:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758075:0:26460:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399809.758086:0:26460:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:2.0:1747399809.758094:0:26460:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399809.758097:0:26460:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399809.758101:0:26460:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758106:0:26460:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399809.758110:0:26460:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399809.758111:0:26460:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399809.758113:0:26460:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b6717b58 00010000:00010000:2.0:1747399809.758114:0:26460:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758118:0:26460:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399809.758123:0:26460:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399809.758133:0:26460:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d1, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1536 00000080:00200000:2.0:1747399809.758135:0:26460:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399809.758139:0:26460:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399809.758142:0:26460:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758147:0:26460:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399809.758151:0:26460:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399809.758152:0:26460:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399809.758154:0:26460:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b6717bf0 00010000:00010000:2.0:1747399809.758155:0:26460:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758160:0:26460:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399809.758165:0:26460:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399809.758168:0:26460:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399809.758170:0:26460:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399809.758173:0:26460:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758177:0:26460:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399809.758181:0:26460:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399809.758183:0:26460:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399809.758188:0:26460:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b6717da0 00010000:00010000:2.0:1747399809.758189:0:26460:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758193:0:26460:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399809.758199:0:26460:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399809.758202:0:26460:0:(namei.c:1935:ll_mkdir()) VFS Op:name=d1, dir=[0x200000007:0x1:0x0](ffff880136f900d8) 00800000:00000004:2.0:1747399809.758211:0:26460:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800b65c8800: age 136, max_age 0 00010000:00010000:2.0:1747399809.758259:0:26460:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758270:0:26460:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399809.758277:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081683904:192.168.204.160@tcp:41:mkdir.0 00010000:00010000:2.0:1747399809.758290:0:26460:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399809.758294:0:26460:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399809.758295:0:26460:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdee0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf6055de expref: -99 pid: 26459 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399809.758306:0:26460:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399809.758323:0:26460:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aada40 x1832281081684032/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399809.758335:0:26460:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26460:1832281081684032:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:2.0:1747399809.759160:0:26460:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 43 seconds 00000100:00100000:2.0:1747399809.763725:0:26460:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26460:1832281081684032:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:2.0:1747399809.763768:0:26460:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x4:0x0](ffff8800af2180d8) 00000080:00200000:2.0:1747399809.763772:0:26460:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x4:0x0], updating i_size 512 00000100:00100000:3.0:1747399809.764255:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081683904:192.168.204.160@tcp:41:mkdir.0 00000080:00200000:3.0:1747399809.772650:0:26461:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399809.772673:0:26461:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399809.772689:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.772702:0:26461:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399809.772713:0:26461:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399809.772715:0:26461:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399809.772721:0:26461:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27af8 00010000:00010000:3.0:1747399809.772727:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.772733:0:26461:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.772747:0:26461:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399809.772757:0:26461:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d1, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1 00000080:00200000:3.0:1747399809.772761:0:26461:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d1, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=getattr 00000002:00010000:3.0:1747399809.772769:0:26461:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d1,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399809.772810:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.772816:0:26461:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.772824:0:26461:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399809.772849:0:26461:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684096:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399809.772939:0:26461:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399809.776826:0:26461:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684096:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399809.776853:0:26461:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.776869:0:26461:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.776874:0:26461:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777058:0:26461:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777070:0:26461:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777080:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777087:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777092:0:26461:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399809.777100:0:26461:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012bf663c0 x1832281081684096/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747399853 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1747399809.777111:0:26461:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777120:0:26461:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/4 (0 0) 00000080:00200000:3.0:1747399809.777149:0:26461:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x4:0x0], updating i_size 512 00000080:00200000:3.0:1747399809.777151:0:26461:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x4:0x0](ffff8800af2180d8): rc = 0 00000080:00010000:3.0:1747399809.777158:0:26461:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x4:0x0](ffff8800af2180d8) for lock 0xd95e55596abdee13 00000080:00010000:3.0:1747399809.777172:0:26461:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x4:0x0](ffff8800af2180d8) 00000080:00010000:3.0:1747399809.777175:0:26461:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdee13 from it ffff8800a9a27bb8 00010000:00010000:3.0:1747399809.777177:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777190:0:26461:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.777229:0:26461:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x4:0x0](ffff8800af2180d8),name=d1 00000002:00010000:3.0:1747399809.777244:0:26461:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399809.777250:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777257:0:26461:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399809.777264:0:26461:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x4:0x0](ffff8800af2180d8) 00000080:00010000:3.0:1747399809.777266:0:26461:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x4:0x0](ffff8800af2180d8) for lock 0xd95e55596abdee13 00000080:00010000:3.0:1747399809.777268:0:26461:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdee13 from it ffff8800a9a27cf8 00010000:00010000:3.0:1747399809.777270:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.777275:0:26461:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22880/0xd95e55596abdee13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605608 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.778264:0:26461:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399809.778273:0:26461:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399809.778280:0:26461:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:3.0:1747399809.778336:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.778342:0:26461:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.778358:0:26461:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399809.778381:0:26461:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684160:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399809.778461:0:26461:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399809.782157:0:26461:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684160:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399809.782180:0:26461:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782192:0:26461:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782201:0:26461:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782210:0:26461:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782218:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782224:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782228:0:26461:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399809.782236:0:26461:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012bf663c0 x1832281081684160/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/688 e 0 to 0 dl 1747399853 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1747399809.782257:0:26461:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782268:0:26461:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1747399809.782300:0:26461:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 10752 00000080:00010000:3.0:1747399809.782307:0:26461:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdee1a 00000080:00010000:3.0:1747399809.782333:0:26461:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399809.782336:0:26461:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdee1a from it ffff8800a9a27cf8 00010000:00010000:3.0:1747399809.782338:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.782344:0:26461:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.782973:0:26461:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399809.782986:0:26461:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399809.783004:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.783013:0:26461:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399809.783021:0:26461:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399809.783022:0:26461:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399809.783026:0:26461:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27bb0 00010000:00010000:3.0:1747399809.783028:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.783042:0:26461:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399809.783050:0:26461:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399809.783055:0:26461:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d1, flags=256 00000080:00200000:3.0:1747399809.783058:0:26461:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x4:0x0](ffff8800af2180d8), inode mode 41ed mask 44 00000080:00200000:3.0:1747399809.783062:0:26461:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x4:0x0](ffff8800af2180d8), flags 504000 00000002:00010000:3.0:1747399809.783075:0:26461:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0240504001 00010000:00010000:3.0:1747399809.783118:0:26461:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.783124:0:26461:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399809.783135:0:26461:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399809.783140:0:26461:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf663c0 x1832281081684288/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399809.783148:0:26461:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399809.783168:0:26461:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684288:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399809.783366:0:26461:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399809.785048:0:26461:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684288:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399809.785066:0:26461:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785078:0:26461:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785092:0:26461:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785098:0:26461:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785109:0:26461:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785114:0:26461:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b22d00 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399809.785117:0:26461:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785123:0:26461:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785128:0:26461:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785135:0:26461:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399809.785138:0:26461:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.785143:0:26461:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdee21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399809.785157:0:26461:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf663c0 x1832281081684288/t4294967307(4294967307) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399853 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399809.785177:0:26461:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf663c0 x1832281081684288/t4294967307(4294967307) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399853 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399809.785206:0:26461:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x4:0x0], updating i_size 512 00000002:00100000:3.0:1747399809.785218:0:26461:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf663c0 x1832281081684288/t4294967307(4294967307) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399853 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399809.785350:0:26461:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x4:0x0](ffff8800af2180d8), cmd=0x8080667f 00000080:00200000:3.0:1747399809.785364:0:26461:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x4:0x0](ffff8800af2180d8) 00000002:00100000:3.0:1747399809.785389:0:26461:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf663c0 x1832281081684288/t4294967307(4294967307) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399853 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:3.0:1747399809.785410:0:26461:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399809.785414:0:26461:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf650c0 x1832281081684416/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399809.785430:0:26461:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684416:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399809.786038:0:26461:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:3.0:1747399809.787902:0:26461:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:26461:1832281081684416:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747399809.787928:0:26461:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf663c0 x1832281081684288/t4294967307(4294967307) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399853 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1747399809.797928:0:26463:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399809.797949:0:26463:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399809.797965:0:26463:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.797979:0:26463:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399809.798011:0:26463:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399809.798014:0:26463:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdee1a 00000080:00010000:3.0:1747399809.798022:0:26463:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdee1a from it ffff8800aae5fcf8 00010000:00010000:3.0:1747399809.798025:0:26463:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399809.798031:0:26463:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399810.685463:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399811.069064:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399811.069464:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089159808 00000100:00100000:0.0:1747399811.069508:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 91 00000100:00100000:0.0:1747399811.069513:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:30457:x1832281089159808:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399811.069528:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399811.069587:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399811.069591:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:30457:x1832281089159808:12345-192.168.204.160@tcp:104: Request processed in 78us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399811.069596:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 91 00010000:00010000:2.0:1747399811.070114:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399811.070118:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399811.070128:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5b00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399811.070130:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399811.070136:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399811.070144:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399811.070147:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399811.070174:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399811.070179:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399811.070202:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399811.070240:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081684480:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399811.071915:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5b00/0xd95e55596abdee05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6055d0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399811.071934:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399811.071935:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399811.071938:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399811.073378:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:3.0:1747399811.073993:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081684480:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399811.074052:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089160640 00000100:00100000:1.0:1747399811.074086:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 92 00000100:00100000:1.0:1747399811.074090:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30457:x1832281089160640:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399811.074100:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399811.074148:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399811.074161:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30457:x1832281089160640:12345-192.168.204.160@tcp:104: Request processed in 66us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399811.074167:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 92 00010000:00010000:3.0:1747399811.074577:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399811.074581:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399811.074588:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399811.074590:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399811.074596:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399811.074601:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399811.074604:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399811.074636:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399811.074645:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399811.074666:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399811.074672:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdedfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605575 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399811.074692:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399811.074693:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399811.074694:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399811.074695:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081684544:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399811.077106:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081684544:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399811.687910:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399812.689970:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399812.957779:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399812.957784:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 208 10000000:01000000:2.0:1747399812.957787:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399812.957821:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.957829:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.957837:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399812.957856:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684608:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399812.957925:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399812.961880:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684608:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399812.961902:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.961911:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399812.961989:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684672:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399812.962054:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399812.965493:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684672:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399812.965572:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684736:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399812.965653:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399812.968103:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684736:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399812.969378:0:26499:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26499:1832281081684800:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399812.969891:0:26499:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399812.972896:0:26499:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26499:1832281081684800:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399812.972949:0:26499:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399812.972958:0:26499:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399812.972960:0:26499:0:(obd_config.c:1460:class_process_config()) marker 137 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399812.972966:0:26499:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399812.972969:0:26499:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399812.972980:0:26499:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399812.973010:0:26499:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26499:1832281081684864:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399812.973074:0:26499:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399812.974950:0:26499:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26499:1832281081684864:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399812.974988:0:26499:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399812.974993:0:26499:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399812.974995:0:26499:0:(obd_config.c:1460:class_process_config()) marker 137 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399812.974998:0:26499:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 211 count 207 00000020:01000000:2.0:1747399812.975208:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 208-210 (rc=0) 10000000:01000000:2.0:1747399812.975230:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399812.975237:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.975248:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399812.975256:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399812.975258:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399812.975260:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399812.975285:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.975291:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.975298:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399812.975356:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684928:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399812.975808:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399812.978445:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684928:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399812.978474:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.978497:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399812.978573:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684992:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399812.978635:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399812.980065:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081684992:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399812.980097:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399812.980103:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399812.980110:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1747399813.483485:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399813.483490:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1747399813.483492:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1747399813.483494:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399813.483531:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081685120:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399813.484212:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081685056:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399813.492051:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081685056:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399813.492555:0:1864:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967308 gen 1 00000100:00100000:3.0:1747399813.492579:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081685120:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399813.532893:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399813.532945:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399813.532995:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089163008 00000100:00100000:1.0:1747399813.533001:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089163072 00000100:00100000:0.0:1747399813.533031:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 93 00000100:00100000:0.0:1747399813.533046:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:30532:x1832281089163008:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399813.533061:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399813.533135:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399813.533139:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:30532:x1832281089163008:12345-192.168.204.160@tcp:104: Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399813.533146:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 93 00000100:00100000:0.0:1747399813.533162:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 94 00000100:00100000:0.0:1747399813.533166:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30532:x1832281089163072:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399813.533171:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399813.533199:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399813.533202:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30532:x1832281089163072:12345-192.168.204.160@tcp:104: Request processed in 36us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399813.533206:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 94 00010000:00010000:2.0:1747399813.533336:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399813.533342:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399813.533351:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5440 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399813.533354:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399813.533360:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399813.533369:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399813.533374:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399813.533379:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399813.533380:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f58c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399813.533383:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399813.533383:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399813.533388:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399813.533394:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399813.533398:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399813.533424:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399813.533424:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399813.533429:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399813.533429:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399813.533443:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399813.533443:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399813.533448:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60569b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399813.533458:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdee28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605694 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399813.533467:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399813.533468:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399813.533469:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399813.533476:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399813.533477:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399813.533478:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399813.533484:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081685184:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399813.533491:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081685248:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399813.538643:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081685248:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399813.539871:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081685184:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399813.694408:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399814.401706:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399814.401710:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 211 10000000:01000000:0.0:1747399814.401715:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399814.401746:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399814.401753:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399814.401760:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399814.401777:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399814.401857:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67539c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399814.405263:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399814.405283:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399814.405291:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399814.405382:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685376:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399814.405439:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399814.408121:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685376:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399814.408163:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685440:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399814.408220:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399814.413547:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685440:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399814.414082:0:26509:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26509:1832281081685504:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399814.414939:0:26509:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399814.417754:0:26509:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26509:1832281081685504:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399814.417789:0:26509:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399814.417796:0:26509:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399814.417797:0:26509:0:(obd_config.c:1460:class_process_config()) marker 139 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399814.417801:0:26509:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399814.417803:0:26509:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399814.417812:0:26509:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:3.0:1747399814.417837:0:26509:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26509:1832281081685568:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399814.417891:0:26509:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399814.423672:0:26509:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26509:1832281081685568:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399814.423703:0:26509:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399814.423708:0:26509:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399814.423710:0:26509:0:(obd_config.c:1460:class_process_config()) marker 139 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399814.423713:0:26509:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 214 count 210 00000020:01000000:2.0:1747399814.424172:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 211-213 (rc=0) 10000000:01000000:2.0:1747399814.424190:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399814.424196:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399814.424205:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399814.424212:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399814.424215:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399814.424216:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399814.424238:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399814.424243:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399814.424249:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399814.424264:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685632:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399814.424307:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399814.427085:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685632:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399814.427104:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399814.427113:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399814.427167:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685696:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399814.427213:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399814.429093:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685696:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399814.429120:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399814.429125:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399814.429133:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399814.695565:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399815.698903:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399816.457838:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399816.457908:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399816.457941:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089166592 00000100:00100000:0.0:1747399816.457944:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089166784 00000100:00100000:0.0:1747399816.457977:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 95 00000100:00100000:0.0:1747399816.457982:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30692:x1832281089166784:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399816.457997:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399816.458078:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399816.458082:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30692:x1832281089166784:12345-192.168.204.160@tcp:104: Request processed in 100us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399816.458089:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 95 00010000:00010000:2.0:1747399816.458149:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399816.458158:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399816.458168:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f21c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399816.458171:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399816.458178:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399816.458180:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 96 00000100:00100000:0.0:1747399816.458184:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:30692:x1832281089166592:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399816.458190:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399816.458197:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399816.458201:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399816.458235:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399816.458239:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:30692:x1832281089166592:12345-192.168.204.160@tcp:104: Request processed in 55us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399816.458243:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 96 00010000:00010000:0.0:1747399816.458262:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1747399816.458266:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399816.458272:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5440 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:0.0:1747399816.458281:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399816.458287:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1747399816.458292:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399816.458296:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399816.458348:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399816.458354:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1747399816.458371:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399816.458377:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5440/0xd95e55596abdee3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6056b0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399816.458392:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399816.458393:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399816.458394:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399816.458401:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1747399816.458416:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081685760:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399816.459136:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399816.459144:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399816.459169:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399816.459174:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f21c0/0xd95e55596abdee36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6056a9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399816.459190:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399816.459191:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399816.459193:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399816.459205:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399816.459221:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081685824:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1747399816.461433:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081685760:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399816.461605:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081685824:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399816.699593:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399817.519913:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399817.519920:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 214 10000000:01000000:0.0:1747399817.519926:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399817.519985:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399817.520014:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399817.520025:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399817.520053:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685888:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399817.520142:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753b40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399817.525675:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685888:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399817.525704:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399817.525716:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399817.525804:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685952:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399817.525903:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbe40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399817.527796:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081685952:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399817.527857:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686016:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399817.529796:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbe40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399817.533569:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686016:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399817.534174:0:26530:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26530:1832281081686080:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399817.534260:0:26530:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399817.538088:0:26530:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26530:1832281081686080:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399817.538133:0:26530:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399817.538141:0:26530:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399817.538143:0:26530:0:(obd_config.c:1460:class_process_config()) marker 141 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399817.538148:0:26530:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399817.538150:0:26530:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399817.538219:0:26530:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26530:1832281081686144:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399817.538275:0:26530:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399817.544968:0:26530:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26530:1832281081686144:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399817.545017:0:26530:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399817.545027:0:26530:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399817.545028:0:26530:0:(obd_config.c:1460:class_process_config()) marker 141 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399817.545032:0:26530:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 217 count 213 00000020:01000000:2.0:1747399817.545118:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 214-216 (rc=0) 10000000:01000000:2.0:1747399817.545143:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399817.545152:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399817.545164:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399817.545174:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399817.545177:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399817.545179:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399817.545221:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399817.545227:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399817.545236:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399817.545260:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686208:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399817.545372:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbe40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399817.548266:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686208:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399817.548301:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399817.548360:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399817.548452:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686272:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399817.549116:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbe40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399817.551244:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686272:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399817.551294:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399817.551301:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399817.551536:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399817.702747:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399818.493858:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399818.493863:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399818.493864:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399818.493866:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399818.493889:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081686336:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399818.493964:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399818.493973:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081686400:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399818.497182:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081686336:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399818.501951:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081686400:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399818.705941:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399819.707772:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399820.710528:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399821.019819:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399821.019863:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399821.019923:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1747399821.019937:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089169600 00000100:00100000:1.0:1747399821.019949:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089169536 00000100:00100000:3.0:1747399821.019999:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 7 00000100:00100000:1.0:1747399821.019999:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 97 00000100:00100000:3.0:1747399821.020005:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+4:31048:x1832281089169600:12345-192.168.204.160@tcp:104: 00000100:00100000:1.0:1747399821.020005:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:31048:x1832281089169536:12345-192.168.204.160@tcp:104: 00010000:00010000:3.0:1747399821.020019:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399821.020019:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399821.020078:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1747399821.020083:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399821.020083:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:31048:x1832281089169536:12345-192.168.204.160@tcp:104: Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1747399821.020088:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+4:31048:x1832281089169600:12345-192.168.204.160@tcp:104: Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399821.020089:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 97 00000100:00100000:3.0:1747399821.020108:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 7 00010000:00010000:3.0:1747399821.020124:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399821.020128:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020134:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5200 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399821.020137:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020144:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399821.020149:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399821.020153:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399821.020187:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020192:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399821.020209:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020214:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdee4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605727 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020227:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399821.020228:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020232:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2400 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399821.020237:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020242:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399821.020246:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399821.020249:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399821.020259:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020263:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399821.020267:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399821.020269:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399821.020270:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2400/0xd95e55596abdee44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605720 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399821.020281:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399821.020282:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399821.020283:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399821.020299:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081686528:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399821.020385:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399821.020391:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081686464:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399821.025681:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081686464:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399821.025694:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081686528:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399821.711483:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399822.067415:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399822.067421:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 217 10000000:01000000:1.0:1747399822.067424:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399822.067456:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.067464:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.067472:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399822.067492:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686592:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399822.067569:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ec00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399822.071180:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686592:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399822.071199:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.071208:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399822.071265:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686656:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399822.071709:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ec00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399822.074047:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686656:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399822.074776:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686720:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399822.074837:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ec00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399822.079046:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686720:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399822.079657:0:26604:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26604:1832281081686784:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399822.079718:0:26604:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399822.098817:0:26604:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26604:1832281081686784:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399822.098856:0:26604:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399822.098864:0:26604:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399822.098865:0:26604:0:(obd_config.c:1460:class_process_config()) marker 143 (0x1) lustre-clilov del lustre.testpool2 00000020:01000000:3.0:1747399822.098870:0:26604:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399822.098872:0:26604:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399822.099559:0:26604:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26604:1832281081686848:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399822.099629:0:26604:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5ba80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399822.102377:0:26604:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:26604:1832281081686848:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399822.102409:0:26604:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399822.102414:0:26604:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399822.102415:0:26604:0:(obd_config.c:1460:class_process_config()) marker 143 (0x2) lustre-clilov del lustre.testpool2 00000040:00080000:3.0:1747399822.102418:0:26604:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 220 count 216 00000020:01000000:1.0:1747399822.103548:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 217-219 (rc=0) 10000000:01000000:1.0:1747399822.103567:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399822.103572:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.103580:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399822.103586:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399822.103587:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399822.103589:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399822.103610:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.103623:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.103630:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399822.103645:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686912:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399822.103703:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ec00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399822.105552:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686912:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399822.105611:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.105621:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399822.105663:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686976:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399822.105706:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59ec00 going to sleep for 6 seconds 00000100:00100000:1.0:1747399822.108195:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081686976:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399822.108224:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399822.108229:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.108237:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399822.715593:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399823.499452:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399823.499457:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399823.499459:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399823.499460:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399823.499490:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081687104:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399823.499564:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399823.499569:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081687040:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399823.502505:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081687040:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399823.502521:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081687104:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399823.716415:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399824.718536:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399825.721204:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399826.375797:0:27234:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399826.375802:0:27234:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 5b: lctl pool_list from MDS ============ 08:50:25 (1747399825) 00010000:00010000:3.0:1747399826.725462:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399827.730767:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399828.231768:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399828.232246:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089172800 00000100:00100000:0.0:1747399828.232249:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399828.232276:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089172864 00000100:00100000:1.0:1747399828.232285:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 98 00000100:00100000:1.0:1747399828.232291:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:31660:x1832281089172800:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399828.232306:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399828.232463:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399828.232468:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:31660:x1832281089172800:12345-192.168.204.160@tcp:104: Request processed in 177us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399828.232474:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 98 00000100:00100000:1.0:1747399828.232487:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 99 00000100:00100000:1.0:1747399828.232490:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:31660:x1832281089172864:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399828.232496:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399828.232527:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399828.232531:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:31660:x1832281089172864:12345-192.168.204.160@tcp:104: Request processed in 40us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399828.232535:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 99 00010000:00010000:2.0:1747399828.232822:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399828.232827:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.232834:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45aac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399828.232837:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.232854:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399828.232859:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399828.232863:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399828.232904:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.232910:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399828.232925:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.232930:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdee59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605800 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.232953:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399828.232955:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.232959:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399828.232960:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399828.232962:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399828.232964:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399828.232968:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399828.232971:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1747399828.232978:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081687168:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399828.232994:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.232998:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399828.233002:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.233006:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a880/0xd95e55596abdee52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6057f9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399828.233016:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399828.233017:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399828.233018:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399828.233114:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081687232:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399828.234889:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081687232:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399828.234967:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081687168:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00080000:2.0:1747399828.507936:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399828.507942:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399828.507944:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399828.507946:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399828.507966:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399828.507989:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081687296:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399828.511554:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081687296:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399828.735058:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399829.735674:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399829.971949:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399829.971957:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 220 10000000:01000000:2.0:1747399829.971963:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399829.972024:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399829.972035:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399829.972045:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399829.972070:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687360:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399829.972762:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399829.978282:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687360:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399829.978351:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399829.978364:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399829.978450:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687424:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399829.979238:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399829.983447:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687424:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399829.983552:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687488:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399829.983685:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399829.986974:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687488:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399829.987753:0:27301:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27301:1832281081687552:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399829.987824:0:27301:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399829.992403:0:27301:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27301:1832281081687552:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399829.992458:0:27301:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399829.992726:0:27301:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399829.992728:0:27301:0:(obd_config.c:1460:class_process_config()) marker 145 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747399829.992734:0:27301:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399829.992737:0:27301:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399829.992756:0:27301:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747399829.992790:0:27301:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27301:1832281081687616:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399829.992863:0:27301:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5ba80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399829.995038:0:27301:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27301:1832281081687616:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399829.995082:0:27301:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399829.995090:0:27301:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399829.995091:0:27301:0:(obd_config.c:1460:class_process_config()) marker 145 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747399829.995095:0:27301:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 224 count 219 00000020:01000000:2.0:1747399829.996082:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 220-223 (rc=0) 10000000:01000000:2.0:1747399829.996109:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399829.996117:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399829.996138:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399829.996147:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399829.996150:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399829.996153:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399829.996183:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399829.996188:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399829.996197:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399829.996218:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687680:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399829.997593:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399829.999305:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687680:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399829.999357:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399829.999367:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399829.999447:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687744:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399830.000127:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399830.003213:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687744:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399830.003278:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399830.003286:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399830.003296:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399830.737459:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399831.199795:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399831.199851:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399831.200542:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089175744 00000100:00100000:1.0:1747399831.200581:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 100 00000100:00100000:1.0:1747399831.200596:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:31851:x1832281089175744:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399831.200611:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399831.200689:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399831.200704:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:31851:x1832281089175744:12345-192.168.204.160@tcp:104: Request processed in 117us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399831.200710:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 100 00010000:00010000:2.0:1747399831.200842:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399831.200848:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.200855:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4fc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399831.200859:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.200865:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399831.200870:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399831.200874:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747399831.201075:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089175680 00000100:00100000:0.0:1747399831.201095:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 101 00000100:00100000:0.0:1747399831.201099:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:31851:x1832281089175680:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399831.201104:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.201767:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.201773:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399831.202033:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.202038:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605870 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399831.202046:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399831.202051:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:31851:x1832281089175680:12345-192.168.204.160@tcp:104: Request processed in 951us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399831.202057:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 101 00010000:00010000:2.0:1747399831.202059:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399831.202061:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.202065:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4d80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399831.202067:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.202072:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399831.202077:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399831.202081:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399831.202095:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.202098:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399831.202102:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.202106:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605877 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.202115:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399831.202115:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399831.202117:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399831.202129:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399831.202144:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081687872:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399831.202201:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399831.202206:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081687808:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399831.206387:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081687808:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399831.206402:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081687872:192.168.204.160@tcp:103:ldlm_bl_01.0 10000000:01000000:2.0:1747399831.648534:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399831.648542:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 224 10000000:01000000:2.0:1747399831.648549:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399831.648626:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.648636:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.648742:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399831.648768:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687936:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399831.649484:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399831.652215:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081687936:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399831.652243:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.652255:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399831.652357:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688000:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399831.652432:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399831.653692:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688000:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399831.653725:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688064:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399831.653776:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399831.655291:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688064:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399831.655899:0:27341:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27341:1832281081688128:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399831.656042:0:27341:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747399831.658077:0:27341:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27341:1832281081688128:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399831.658118:0:27341:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399831.658127:0:27341:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399831.658129:0:27341:0:(obd_config.c:1460:class_process_config()) marker 147 (0x1) lustre-clilov new lustre.testpool2 00000020:01000000:3.0:1747399831.658135:0:27341:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399831.658137:0:27341:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399831.658157:0:27341:0:(lov_pool.c:313:lov_pool_new()) testpool2 is pool #2 00000100:00100000:3.0:1747399831.658184:0:27341:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27341:1832281081688192:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399831.658245:0:27341:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399831.660998:0:27341:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27341:1832281081688192:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399831.661040:0:27341:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399831.661055:0:27341:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399831.661057:0:27341:0:(obd_config.c:1460:class_process_config()) marker 147 (0x2) lustre-clilov new lustre.testpool2 00000040:00080000:3.0:1747399831.661061:0:27341:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 227 count 222 00000020:01000000:2.0:1747399831.661772:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 224-226 (rc=0) 10000000:01000000:2.0:1747399831.661797:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399831.661804:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.661814:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399831.661823:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399831.661825:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399831.661827:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399831.661858:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.661864:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.661871:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399831.661890:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688256:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399831.661961:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399831.663727:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688256:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399831.663750:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.663760:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399831.663820:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688320:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399831.663878:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399831.665610:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688320:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399831.665664:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399831.665674:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399831.665684:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399831.739624:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399832.741972:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399833.516090:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081688384:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00080000:2.0:1747399833.516420:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399833.516424:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399833.516426:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399833.516428:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399833.516448:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081688448:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399833.520395:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081688384:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399833.521016:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081688448:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399833.743553:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399834.744599:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399834.745959:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00010000:00010000:2.0:1747399834.746425:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399834.746479:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089179392 00000100:00100000:1.0:1747399834.746507:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089179904 00000100:00100000:1.0:1747399834.746517:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 102 00000100:00100000:1.0:1747399834.746531:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:32101:x1832281089179392:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399834.746541:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399834.746599:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399834.746604:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:32101:x1832281089179392:12345-192.168.204.160@tcp:104: Request processed in 82us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399834.746609:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 102 00000100:00100000:1.0:1747399834.746621:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 103 00000100:00100000:1.0:1747399834.746624:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:32101:x1832281089179904:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399834.746629:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399834.746657:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399834.746660:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:32101:x1832281089179904:12345-192.168.204.160@tcp:104: Request processed in 35us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399834.746664:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 103 00010000:00010000:3.0:1747399834.746717:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399834.746726:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746735:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4d80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399834.746738:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746746:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399834.746751:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399834.746755:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399834.746800:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746818:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399834.746837:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746842:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60588c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746859:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399834.746861:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746866:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f46c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399834.746867:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746872:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399834.746876:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399834.746880:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399834.746890:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746894:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399834.746897:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746901:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605885 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399834.746918:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399834.746919:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399834.746920:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399834.746949:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081688512:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399834.746952:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399834.746968:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081688576:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399834.749417:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081688576:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399834.750459:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081688512:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399835.749098:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399836.167429:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399836.167436:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 227 10000000:01000000:3.0:1747399836.167442:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399836.167487:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399836.167521:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399836.167531:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399836.167554:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688640:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399836.167633:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399836.171263:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688640:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399836.171285:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399836.171295:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399836.171369:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688704:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399836.171430:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399836.173391:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688704:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399836.173428:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688768:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399836.173478:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399836.175780:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688768:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399836.176264:0:27388:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27388:1832281081688832:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399836.176341:0:27388:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399836.179447:0:27388:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27388:1832281081688832:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399836.179479:0:27388:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399836.179485:0:27388:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399836.179487:0:27388:0:(obd_config.c:1460:class_process_config()) marker 149 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399836.179491:0:27388:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399836.179492:0:27388:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399836.179512:0:27388:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000020:01000000:3.0:1747399836.179515:0:27388:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399836.179517:0:27388:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399836.179518:0:27388:0:(obd_config.c:1460:class_process_config()) marker 149 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399836.179519:0:27388:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399836.179521:0:27388:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399836.179521:0:27388:0:(obd_config.c:1460:class_process_config()) marker 151 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399836.179523:0:27388:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399836.179525:0:27388:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399836.179527:0:27388:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747399836.179549:0:27388:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27388:1832281081688896:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399836.179591:0:27388:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399836.183870:0:27388:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27388:1832281081688896:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399836.183904:0:27388:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399836.183909:0:27388:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399836.183911:0:27388:0:(obd_config.c:1460:class_process_config()) marker 151 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399836.183914:0:27388:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 233 count 228 00000020:01000000:0.0:1747399836.184228:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 227-232 (rc=0) 10000000:01000000:0.0:1747399836.184253:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399836.184258:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399836.184266:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399836.184272:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399836.184274:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399836.184276:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399836.184296:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399836.184301:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399836.184307:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399836.184346:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688960:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399836.184401:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753b40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399836.188729:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081688960:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399836.188749:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399836.188758:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399836.188816:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689024:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399836.188861:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399836.192687:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689024:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399836.192720:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399836.192726:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399836.192733:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399836.749783:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399837.753940:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399838.524873:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399838.524878:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399838.524880:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399838.524882:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399838.524918:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081689152:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399838.525354:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081689088:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399838.535138:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081689152:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399838.535284:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081689088:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399838.756843:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399839.759992:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399840.546398:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399840.546440:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399840.546460:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089182208 00000100:00100000:0.0:1747399840.546463:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399840.546487:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 104 00000100:00100000:1.0:1747399840.546491:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:32643:x1832281089182208:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399840.546511:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399840.546561:0:4657:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089182272 00010000:00010000:1.0:1747399840.546571:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399840.546575:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:32643:x1832281089182208:12345-192.168.204.160@tcp:104: Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399840.546581:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 104 00000100:00100000:2.0:1747399840.546583:0:4657:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 8 00000100:00100000:2.0:1747399840.546586:0:4657:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+4:32643:x1832281089182272:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399840.546592:0:4657:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399840.546616:0:4657:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1747399840.546617:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1747399840.546619:0:4657:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:32643:x1832281089182272:12345-192.168.204.160@tcp:104: Request processed in 32us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1747399840.546620:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399840.546623:0:4657:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 8 00010000:00010000:1.0:1747399840.546625:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399840.546628:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399840.546633:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1747399840.546633:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399840.546635:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399840.546637:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399840.546640:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b22f40 already unused, calling callback (ffffffffa05055c0) 10000000:01000000:1.0:1747399840.546640:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1747399840.546641:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399840.546645:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399840.546650:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399840.546652:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399840.546661:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399840.546663:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399840.546664:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399840.546667:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399840.546675:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399840.546675:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399840.546679:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2640/0xd95e55596abdee83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60596c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399840.546687:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b22f40/0xd95e55596abdee7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605965 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399840.546696:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399840.546698:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399840.546699:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399840.546700:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399840.546701:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399840.546703:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399840.546704:0:1862:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399840.546713:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1747399840.546719:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081689216:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399840.546721:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081689280:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399840.553199:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081689216:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399840.553768:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081689280:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399840.761677:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399841.763522:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399842.148426:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399842.148432:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 233 10000000:01000000:2.0:1747399842.148436:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399842.148467:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.148475:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.148483:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399842.148502:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689344:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399842.148732:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399842.153794:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689344:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399842.153815:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.153834:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399842.153890:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689408:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399842.154987:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399842.162814:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689408:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399842.162861:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689472:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399842.162926:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399842.169098:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689472:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399842.169612:0:27471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27471:1832281081689536:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399842.169727:0:27471:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399842.173999:0:27471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27471:1832281081689536:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399842.174033:0:27471:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399842.174040:0:27471:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399842.174041:0:27471:0:(obd_config.c:1460:class_process_config()) marker 153 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399842.174046:0:27471:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399842.174048:0:27471:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399842.174057:0:27471:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399842.174083:0:27471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27471:1832281081689600:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399842.174143:0:27471:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399842.177486:0:27471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27471:1832281081689600:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399842.177518:0:27471:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399842.177523:0:27471:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399842.177530:0:27471:0:(obd_config.c:1460:class_process_config()) marker 153 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399842.177533:0:27471:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 236 count 231 00000020:01000000:2.0:1747399842.179931:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 233-235 (rc=0) 10000000:01000000:2.0:1747399842.179952:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399842.179957:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.179966:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399842.179973:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399842.179975:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399842.179976:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399842.179998:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.180003:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.180010:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399842.180036:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399842.180091:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399842.185599:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399842.185617:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.185627:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399842.185676:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689728:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399842.185722:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399842.187540:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081689728:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399842.187574:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399842.187579:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.187587:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399842.765969:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399843.044447:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399843.044504:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399843.044542:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089185472 00000100:00100000:1.0:1747399843.044547:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089185536 00000100:00100000:0.0:1747399843.044579:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 105 00000100:00100000:0.0:1747399843.044585:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:32718:x1832281089185472:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399843.044599:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399843.044689:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399843.044693:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:32718:x1832281089185472:12345-192.168.204.160@tcp:104: Request processed in 108us (254us total) trans 0 rc 0/0 00010000:00010000:3.0:1747399843.044730:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399843.044736:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399843.044744:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4d80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399843.044747:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399843.044753:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399843.044757:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399843.044761:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747399843.044799:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 105 00010000:00010000:3.0:1747399843.044802:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399843.044806:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1747399843.044816:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 106 00000100:00100000:0.0:1747399843.044819:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:32718:x1832281089185536:12345-192.168.204.160@tcp:104: 00010000:00010000:3.0:1747399843.044822:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399843.044824:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399843.044826:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4d80/0xd95e55596abdee91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6059e3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399843.044837:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399843.044838:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399843.044839:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399843.044844:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1747399843.044852:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399843.044855:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:32718:x1832281089185536:12345-192.168.204.160@tcp:104: Request processed in 35us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1747399843.044858:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081689792:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1747399843.044859:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 106 00010000:00010000:0.0:1747399843.044883:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1747399843.044886:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399843.044892:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f46c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:0.0:1747399843.044894:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399843.044899:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1747399843.044904:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399843.044908:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399843.044932:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399843.045636:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1747399843.045653:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399843.045659:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6059dc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399843.045674:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081689856:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1747399843.045683:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399843.045684:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399843.045685:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399843.048931:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081689856:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399843.049198:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081689792:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399843.531969:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081689920:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00080000:2.0:1747399843.532697:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399843.532701:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399843.532703:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399843.532705:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399843.532731:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399843.532739:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081689984:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399843.536058:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081689984:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399843.536069:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081689920:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399843.768632:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399844.460488:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399844.460494:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 236 10000000:01000000:2.0:1747399844.460499:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399844.460534:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.460542:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.460550:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399844.460569:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690048:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399844.460641:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399844.467547:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690048:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399844.467572:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.467739:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399844.468490:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690112:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399844.468564:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399844.473686:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690112:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399844.473906:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690176:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399844.473998:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399844.478057:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690176:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399844.479013:0:27491:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27491:1832281081690240:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399844.479074:0:27491:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399844.487410:0:27491:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27491:1832281081690240:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399844.487443:0:27491:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399844.487449:0:27491:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399844.487450:0:27491:0:(obd_config.c:1460:class_process_config()) marker 155 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399844.487455:0:27491:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399844.487457:0:27491:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399844.487465:0:27491:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:3.0:1747399844.487489:0:27491:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27491:1832281081690304:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399844.487551:0:27491:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399844.493055:0:27491:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27491:1832281081690304:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399844.493091:0:27491:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399844.493096:0:27491:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399844.493098:0:27491:0:(obd_config.c:1460:class_process_config()) marker 155 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399844.493101:0:27491:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 239 count 234 00000020:01000000:2.0:1747399844.493295:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 236-238 (rc=0) 10000000:01000000:2.0:1747399844.493335:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399844.493349:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.493359:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399844.493366:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399844.493368:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399844.493370:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399844.493390:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.493395:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.493401:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399844.493416:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690368:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399844.495089:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399844.500361:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690368:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399844.500382:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.500390:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399844.500446:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690432:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399844.501465:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbd80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399844.504501:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690432:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399844.504536:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399844.504542:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.504549:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399844.769528:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399844.910030:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399844.911266:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399844.911302:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089188288 00000100:00100000:1.0:1747399844.911353:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089188352 00000100:00100000:1.0:1747399844.911363:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 107 00000100:00100000:1.0:1747399844.911368:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:412:x1832281089188288:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399844.911381:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399844.911442:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399844.911447:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:412:x1832281089188288:12345-192.168.204.160@tcp:104: Request processed in 79us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399844.911452:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 107 00010000:00010000:2.0:1747399844.911454:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399844.911458:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.911464:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4fc0 already unused, calling callback (ffffffffa05055c0) 00000100:00100000:1.0:1747399844.911465:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 108 10000000:00010000:2.0:1747399844.911467:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399844.911468:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:412:x1832281089188352:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399844.911472:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399844.911472:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399844.911477:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399844.911486:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399844.911498:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399844.911501:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:412:x1832281089188352:12345-192.168.204.160@tcp:104: Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399844.911505:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 108 00010000:00010000:2.0:1747399844.911527:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399844.911527:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1747399844.911530:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.911532:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399844.911535:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f46c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399844.911537:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399844.911541:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399844.911545:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399844.911547:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399844.911549:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399844.911551:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdee9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605a5a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399844.911560:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399844.911564:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399844.911565:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399844.911566:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399844.911567:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399844.911574:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399844.911578:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f46c0/0xd95e55596abdee98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605a53 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399844.911580:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081690496:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1747399844.911589:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399844.911594:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399844.911595:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399844.911601:0:1862:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1747399844.911609:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081690560:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399844.914730:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081690560:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399844.914969:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081690496:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399845.772073:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399846.505439:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399846.505446:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 239 10000000:01000000:3.0:1747399846.505452:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399846.505499:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399846.505526:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399846.505535:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399846.505558:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690624:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399846.505646:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399846.510456:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690624:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399846.510480:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399846.510491:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399846.510566:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690688:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399846.510628:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399846.516465:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690688:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399846.516532:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690752:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399846.516613:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399846.520463:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690752:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399846.521602:0:27520:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27520:1832281081690816:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399846.521664:0:27520:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399846.525630:0:27520:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27520:1832281081690816:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399846.525663:0:27520:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399846.525670:0:27520:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399846.525671:0:27520:0:(obd_config.c:1460:class_process_config()) marker 157 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399846.525676:0:27520:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399846.525677:0:27520:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399846.525732:0:27520:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27520:1832281081690880:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399846.525953:0:27520:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399846.530069:0:27520:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27520:1832281081690880:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399846.530101:0:27520:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399846.530106:0:27520:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399846.530108:0:27520:0:(obd_config.c:1460:class_process_config()) marker 157 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399846.530112:0:27520:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 242 count 237 00000020:01000000:0.0:1747399846.530239:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 239-241 (rc=0) 10000000:01000000:0.0:1747399846.530255:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399846.530261:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399846.530270:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399846.530277:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399846.530279:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399846.530282:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399846.530341:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399846.530347:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399846.530353:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399846.530973:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690944:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399846.531033:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399846.533612:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081690944:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399846.533632:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399846.533640:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399846.533701:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691008:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399846.533751:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399846.535059:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691008:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399846.535090:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399846.535094:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399846.535100:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399846.773938:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399847.775839:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399848.539460:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399848.539465:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399848.539466:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399848.539468:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399848.539489:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081691072:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399848.539489:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081691136:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399848.541753:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081691136:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399848.543884:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081691072:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399848.782992:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399849.152769:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399849.152823:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399849.152861:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089191552 00000100:00100000:0.0:1747399849.152893:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089191616 00000100:00100000:0.0:1747399849.152901:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 109 00000100:00100000:0.0:1747399849.152906:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:772:x1832281089191552:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399849.152926:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399849.153609:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399849.153615:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:772:x1832281089191552:12345-192.168.204.160@tcp:104: Request processed in 708us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399849.153622:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 109 00000100:00100000:0.0:1747399849.153639:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 110 00000100:00100000:0.0:1747399849.153643:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:772:x1832281089191616:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399849.153649:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153692:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399849.153698:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153704:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399849.153708:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153714:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399849.153719:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399849.153733:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399849.153784:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153789:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399849.153809:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153814:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdeead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605ad1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153828:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399849.153830:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153834:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b23180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399849.153836:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153840:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399849.153844:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399849.153848:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399849.153858:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153862:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399849.153865:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153874:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdeea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605aca expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399849.153884:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399849.153885:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399849.153886:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399849.153902:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691264:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399849.153946:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399849.153951:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691200:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1747399849.154049:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1747399849.154055:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:772:x1832281089191616:12345-192.168.204.160@tcp:104: Request processed in 410us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399849.154060:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 110 00010000:00010000:1.0:1747399849.154152:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399849.157603:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691200:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399849.157615:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691264:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399849.783715:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399850.197491:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399850.197496:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 242 10000000:01000000:3.0:1747399850.197500:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399850.197532:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399850.197540:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399850.197548:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399850.197574:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691328:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399850.197644:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399850.202483:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691328:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399850.202503:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399850.202511:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399850.202566:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691392:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399850.202606:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399850.206459:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691392:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399850.206510:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691456:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399850.207018:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399850.209609:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691456:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399850.210127:0:27582:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27582:1832281081691520:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399850.210192:0:27582:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399850.213483:0:27582:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27582:1832281081691520:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399850.213846:0:27582:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399850.213855:0:27582:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399850.213856:0:27582:0:(obd_config.c:1460:class_process_config()) marker 159 (0x1) lustre-clilov del lustre.testpool2 00000020:01000000:3.0:1747399850.213862:0:27582:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399850.213873:0:27582:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399850.213948:0:27582:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27582:1832281081691584:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399850.214007:0:27582:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399850.217963:0:27582:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:27582:1832281081691584:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399850.218012:0:27582:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399850.218019:0:27582:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399850.218021:0:27582:0:(obd_config.c:1460:class_process_config()) marker 159 (0x2) lustre-clilov del lustre.testpool2 00000040:00080000:3.0:1747399850.218025:0:27582:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 245 count 240 00000020:01000000:0.0:1747399850.218346:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 242-244 (rc=0) 10000000:01000000:0.0:1747399850.218376:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399850.218384:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399850.218393:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399850.218402:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399850.218405:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399850.218407:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399850.218439:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399850.218445:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399850.218454:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399850.218473:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691648:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399850.218618:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67533c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399850.220660:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691648:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399850.220685:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399850.220696:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399850.220771:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691712:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399850.220816:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e780 going to sleep for 6 seconds 00000100:00100000:1.0:1747399850.225304:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081691712:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399850.225416:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399850.225425:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399850.225435:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399850.787596:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399851.789400:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399852.793384:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399853.547461:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399853.547466:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399853.547468:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399853.547470:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399853.547493:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081691840:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399853.547570:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399853.547574:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691776:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399853.552188:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081691840:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399853.552568:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691776:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399853.795699:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399854.720862:0:28213:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399854.720871:0:28213:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 6: getstripe/setstripe ================= 08:50:54 (1747399854) 00010000:00010000:0.0:1747399854.797355:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399855.200367:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399855.200417:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399855.200692:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399855.200715:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089195264 00000100:00100000:1.0:1747399855.200758:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 111 00000100:00100000:1.0:1747399855.200763:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:1217:x1832281089195264:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399855.200774:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399855.201285:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399855.201290:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:1217:x1832281089195264:12345-192.168.204.160@tcp:104: Request processed in 527us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399855.201296:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 111 00010000:00010000:3.0:1747399855.201455:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399855.201460:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399855.201466:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399855.201468:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399855.201474:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399855.201478:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399855.201482:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399855.201508:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399855.201512:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399855.201526:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399855.201539:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdeebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605ae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399855.201550:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399855.201551:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399855.201552:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399855.201565:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081691904:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399855.201676:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089195328 00000100:00100000:2.0:1747399855.201701:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 9 00000100:00100000:2.0:1747399855.201704:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:1217:x1832281089195328:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399855.201713:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399855.201737:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1747399855.201740:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:1217:x1832281089195328:12345-192.168.204.160@tcp:104: Request processed in 36us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1747399855.201745:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 9 00010000:00010000:2.0:1747399855.201762:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399855.201764:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399855.201769:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b233c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399855.201771:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399855.201775:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399855.201778:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399855.201782:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399855.201792:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399855.201796:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399855.201813:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399855.201817:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b233c0/0xd95e55596abdeeb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605adf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399855.201829:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399855.201830:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399855.201831:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399855.201845:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691968:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399855.204434:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081691968:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399855.204465:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081691904:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399855.799506:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399856.211417:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399856.211423:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 245 10000000:01000000:1.0:1747399856.211427:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399856.211461:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.211469:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.211478:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399856.211498:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692032:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399856.211569:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399856.215793:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692032:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399856.215812:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.215820:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399856.215884:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692096:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399856.215932:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399856.220279:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692096:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399856.220350:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692160:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399856.220410:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399856.227659:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692160:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399856.229690:0:28244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28244:1832281081692224:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399856.229755:0:28244:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399856.236006:0:28244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28244:1832281081692224:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399856.236044:0:28244:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399856.236052:0:28244:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399856.236053:0:28244:0:(obd_config.c:1460:class_process_config()) marker 161 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747399856.236059:0:28244:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399856.236061:0:28244:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399856.236077:0:28244:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747399856.236103:0:28244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28244:1832281081692288:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399856.236175:0:28244:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399856.238967:0:28244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28244:1832281081692288:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399856.239005:0:28244:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399856.239011:0:28244:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399856.239013:0:28244:0:(obd_config.c:1460:class_process_config()) marker 161 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747399856.239017:0:28244:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 248 count 243 00000020:01000000:1.0:1747399856.239094:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 245-247 (rc=0) 10000000:01000000:1.0:1747399856.239115:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399856.239129:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.239139:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399856.239147:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399856.239149:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399856.239151:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399856.239173:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.239178:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.239185:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399856.239200:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399856.239250:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399856.241093:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399856.241108:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.241117:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399856.241175:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692416:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399856.241206:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399856.245203:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692416:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399856.245243:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399856.245250:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399856.245259:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399856.802483:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399857.803688:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399858.483995:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399858.485049:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399858.485659:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089198528 00000100:00100000:1.0:1747399858.485686:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089199040 00000100:00100000:1.0:1747399858.485700:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 112 00000100:00100000:1.0:1747399858.485704:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:1464:x1832281089198528:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399858.485716:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399858.486051:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399858.486056:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:1464:x1832281089198528:12345-192.168.204.160@tcp:104: Request processed in 352us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399858.486072:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 112 00000100:00100000:1.0:1747399858.486096:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 113 00000100:00100000:1.0:1747399858.486099:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:1464:x1832281089199040:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399858.486104:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399858.486136:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399858.486140:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:1464:x1832281089199040:12345-192.168.204.160@tcp:104: Request processed in 40us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399858.486144:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 113 00010000:00010000:2.0:1747399858.486223:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399858.486227:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486232:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45af40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399858.486235:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486240:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399858.486245:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399858.486248:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399858.486285:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486290:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399858.486304:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486328:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45af40/0xd95e55596abdeec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605b5d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486340:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399858.486342:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486345:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45ad00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399858.486346:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486350:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399858.486353:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399858.486356:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399858.486365:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486368:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399858.486371:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486374:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45ad00/0xd95e55596abdeec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605b56 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399858.486387:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399858.486387:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399858.486389:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399858.486401:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081692480:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399858.486435:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399858.486439:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081692544:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399858.486529:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399858.488246:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081692544:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399858.488253:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081692480:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00080000:2.0:1747399858.555668:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399858.555674:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399858.555676:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399858.555678:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399858.555692:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399858.555711:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081692608:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399858.558728:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081692608:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399858.805478:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399859.807812:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399860.181497:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399860.181502:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 248 10000000:01000000:2.0:1747399860.181506:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399860.181545:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.181569:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.181577:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399860.181661:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692672:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399860.181729:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399860.184107:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692672:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399860.184126:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.184135:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399860.184191:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692736:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399860.184243:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399860.186473:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692736:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399860.186536:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692800:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399860.186602:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399860.189402:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692800:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399860.189774:0:28295:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28295:1832281081692864:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399860.189978:0:28295:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399860.194608:0:28295:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28295:1832281081692864:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399860.194659:0:28295:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399860.194667:0:28295:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399860.194669:0:28295:0:(obd_config.c:1460:class_process_config()) marker 163 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399860.194675:0:28295:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399860.194678:0:28295:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399860.194690:0:28295:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000020:01000000:3.0:1747399860.194694:0:28295:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399860.194695:0:28295:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399860.194696:0:28295:0:(obd_config.c:1460:class_process_config()) marker 163 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399860.194698:0:28295:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399860.194699:0:28295:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399860.194700:0:28295:0:(obd_config.c:1460:class_process_config()) marker 165 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399860.194703:0:28295:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399860.194704:0:28295:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399860.194706:0:28295:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747399860.194738:0:28295:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28295:1832281081692928:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399860.194802:0:28295:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747399860.198390:0:28295:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28295:1832281081692928:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399860.198438:0:28295:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399860.198444:0:28295:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399860.198446:0:28295:0:(obd_config.c:1460:class_process_config()) marker 165 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399860.198450:0:28295:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 254 count 249 00000020:01000000:2.0:1747399860.198842:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 248-253 (rc=0) 10000000:01000000:2.0:1747399860.198865:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399860.198873:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.198893:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399860.198903:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399860.198906:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399860.198908:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399860.198937:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.198943:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.198951:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399860.198970:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692992:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399860.199040:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399860.201577:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081692992:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399860.201603:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.201613:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399860.201680:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081693056:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399860.201741:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399860.202805:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081693056:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399860.202848:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399860.202854:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399860.202862:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.809481:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1747399860.961583:0:28316:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399860.961601:0:28316:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.961616:0:28316:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961626:0:28316:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399860.961635:0:28316:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399860.961637:0:28316:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399860.961643:0:28316:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aae3be00 00010000:00010000:3.0:1747399860.961644:0:28316:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961649:0:28316:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.961661:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:3.0:1747399860.961668:0:28316:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399860.961672:0:28316:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.961675:0:28316:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961680:0:28316:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399860.961685:0:28316:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399860.961686:0:28316:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399860.961688:0:28316:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aae3bb58 00010000:00010000:3.0:1747399860.961689:0:28316:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961700:0:28316:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.961706:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399860.961712:0:28316:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d6.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1536 00000080:00200000:3.0:1747399860.961715:0:28316:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399860.961718:0:28316:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.961721:0:28316:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961726:0:28316:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399860.961730:0:28316:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399860.961732:0:28316:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399860.961734:0:28316:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aae3bbf0 00010000:00010000:3.0:1747399860.961735:0:28316:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961739:0:28316:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.961744:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399860.961747:0:28316:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399860.961750:0:28316:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.961752:0:28316:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961762:0:28316:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399860.961767:0:28316:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399860.961768:0:28316:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399860.961770:0:28316:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aae3bda0 00010000:00010000:3.0:1747399860.961771:0:28316:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961775:0:28316:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.961780:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399860.961783:0:28316:0:(namei.c:1935:ll_mkdir()) VFS Op:name=d6.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8) 00010000:00010000:3.0:1747399860.961800:0:28316:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961808:0:28316:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961836:0:28316:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.961840:0:28316:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399860.961841:0:28316:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdee1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf605616 expref: -99 pid: 26461 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399860.961853:0:28316:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399860.961861:0:28316:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf67200 x1832281081693184/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399860.961881:0:28316:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693184:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:3.0:1747399860.961949:0:28316:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399860.966523:0:28316:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf67200 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693184:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:3.0:1747399860.966550:0:28316:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898) 00000080:00200000:3.0:1747399860.966554:0:28316:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x5:0x0], updating i_size 512 00000080:00200000:3.0:1747399860.966590:0:28316:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399860.966599:0:28316:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.966609:0:28316:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.966618:0:28316:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399860.966624:0:28316:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399860.966625:0:28316:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399860.966630:0:28316:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aae3bbb0 00010000:00010000:3.0:1747399860.966632:0:28316:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.966637:0:28316:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.966646:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399860.966654:0:28316:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=d6.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), file ffff8800b6e65500, open_flags 38900, mode 0 opened 0 00000080:00200000:3.0:1747399860.966658:0:28316:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d6.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=open 00000002:00010000:3.0:1747399860.966663:0:28316:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d6.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0704401 00010000:00010000:3.0:1747399860.966697:0:28316:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.966701:0:28316:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399860.966708:0:28316:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399860.966712:0:28316:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf676c0 x1832281081693312/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399860.966718:0:28316:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399860.966730:0:28316:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693312:192.168.204.160@tcp:101:mkdir.0 00000100:00100000:3.0:1747399860.966812:0:28316:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399860.970272:0:28316:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693312:192.168.204.160@tcp:101:mkdir.0 00010000:00010000:3.0:1747399860.970286:0:28316:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970298:0:28316:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970303:0:28316:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970307:0:28316:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970336:0:28316:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970353:0:28316:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b23600 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399860.970356:0:28316:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970361:0:28316:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970367:0:28316:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970371:0:28316:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399860.970374:0:28316:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.970379:0:28316:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23600/0xd95e55596abdeede lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28316 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399860.970392:0:28316:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf676c0 x1832281081693312/t4294967310(4294967310) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747399904 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000002:00100000:3.0:1747399860.970401:0:28316:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf676c0 x1832281081693312/t4294967310(4294967310) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747399904 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:3.0:1747399860.970431:0:28316:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x5:0x0], updating i_size 512 00000080:00200000:3.0:1747399860.970434:0:28316:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x5:0x0](ffff880136f90898): rc = 0 00000080:00010000:3.0:1747399860.970437:0:28316:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x5:0x0](ffff880136f90898) for lock 0x0 00000080:00200000:3.0:1747399860.970454:0:28316:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), flags 704400 00000002:00100000:3.0:1747399860.970465:0:28316:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf676c0 x1832281081693312/t4294967310(4294967310) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747399904 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:3.0:1747399860.970523:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 44 00000080:00200000:3.0:1747399860.970550:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 101 00000080:00200000:3.0:1747399860.970561:0:28316:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898) 00000002:00100000:3.0:1747399860.970581:0:28316:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf676c0 x1832281081693312/t4294967310(4294967310) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747399904 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000020:00100000:3.0:1747399860.970600:0:28316:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399860.970603:0:28316:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf66d40 x1832281081693440/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399860.970616:0:28316:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693440:192.168.204.160@tcp:35:mkdir.0 00000100:00100000:3.0:1747399860.970890:0:28316:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:3.0:1747399860.975710:0:28316:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693440:192.168.204.160@tcp:35:mkdir.0 00000002:00100000:3.0:1747399860.975734:0:28316:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf676c0 x1832281081693312/t4294967310(4294967310) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747399904 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000080:00200000:3.0:1747399860.975770:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:3.0:1747399860.975779:0:28316:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), flags=1536 00000080:00200000:3.0:1747399860.975782:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 3 00000080:00200000:3.0:1747399860.975785:0:28316:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 3 00000080:00200000:3.0:1747399860.975788:0:28316:0:(namei.c:1935:ll_mkdir()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898) 00000020:00100000:3.0:1747399860.975830:0:28316:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399860.975834:0:28316:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf66d40 x1832281081693568/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399860.975849:0:28316:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693568:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:3.0:1747399860.975898:0:28316:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399860.979124:0:28316:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66d40 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28316:1832281081693568:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:3.0:1747399860.979162:0:28316:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058) 00000080:00200000:3.0:1747399860.979166:0:28316:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x6:0x0], updating i_size 512 00000080:00200000:3.0:1747399860.983356:0:28317:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399860.983372:0:28317:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.983385:0:28317:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.983394:0:28317:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399860.983402:0:28317:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399860.983404:0:28317:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399860.983410:0:28317:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3abbbb0 00010000:00010000:3.0:1747399860.983412:0:28317:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.983418:0:28317:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.983429:0:28317:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399860.983437:0:28317:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d6.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=17 00000080:00200000:3.0:1747399860.983440:0:28317:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d6.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=0 00000002:00010000:3.0:1747399860.983446:0:28317:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d6.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.983477:0:28317:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.983483:0:28317:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.983499:0:28317:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399860.983519:0:28317:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081693632:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399860.983714:0:28317:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399860.988656:0:28317:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081693632:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399860.988676:0:28317:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988691:0:28317:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988696:0:28317:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988704:0:28317:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988711:0:28317:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988718:0:28317:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988724:0:28317:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988729:0:28317:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399860.988745:0:28317:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff88012bf676c0 x1832281081693632/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747399904 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1747399860.988754:0:28317:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988761:0:28317:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/5 (0 0) 00000080:00200000:3.0:1747399860.988780:0:28317:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x5:0x0], updating i_size 512 00000080:00200000:3.0:1747399860.988782:0:28317:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x5:0x0](ffff880136f90898): rc = 0 00000080:00010000:3.0:1747399860.988786:0:28317:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x5:0x0](ffff880136f90898) for lock 0xd95e55596abdeee5 00000080:00010000:3.0:1747399860.988795:0:28317:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x5:0x0](ffff880136f90898) 00000080:00010000:3.0:1747399860.988797:0:28317:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdeee5 from it ffff8800b3abbb20 00010000:00010000:3.0:1747399860.988799:0:28317:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988804:0:28317:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22ac0/0xd95e55596abdeee5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605c91 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.988827:0:28317:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:3.0:1747399860.988839:0:28317:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 3 00000080:00200000:3.0:1747399860.988842:0:28317:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), file ffff8800b6df4180, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1747399860.988848:0:28317:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open|creat 00000002:00010000:3.0:1747399860.988860:0:28317:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir_tst,[0x200000401:0x7:0x0]) in obj [0x200000401:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1747399860.988892:0:28317:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.988898:0:28317:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399860.988911:0:28317:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399860.988915:0:28317:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf676c0 x1832281081693760/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399860.988921:0:28317:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399860.988936:0:28317:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081693760:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399860.989042:0:28317:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399860.994184:0:28317:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081693760:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399860.994199:0:28317:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994209:0:28317:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994213:0:28317:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994218:0:28317:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 3/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994222:0:28317:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 4/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994227:0:28317:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b23840 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399860.994230:0:28317:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 4/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994246:0:28317:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 4/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994251:0:28317:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 5/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994256:0:28317:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399860.994259:0:28317:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 3/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994263:0:28317:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23840/0xd95e55596abdeeec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399860.994277:0:28317:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff88012bf676c0 x1832281081693760/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399904 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399860.994388:0:28317:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399860.994400:0:28317:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399860.994408:0:28317:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994415:0:28317:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399860.994422:0:28317:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399860.994424:0:28317:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399860.994428:0:28317:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3abbbb0 00010000:00010000:3.0:1747399860.994429:0:28317:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994443:0:28317:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399860.994453:0:28317:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399860.994458:0:28317:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d6.ost-pools, flags=19 00000080:00200000:3.0:1747399860.994460:0:28317:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:3.0:1747399860.994467:0:28317:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), file ffff8800b6df4900, open_flags 1a100, mode 0 opened 0 00000080:00200000:3.0:1747399860.994471:0:28317:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open 00000002:00010000:3.0:1747399860.994477:0:28317:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir_tst,[0x0:0x0:0x0]) in obj [0x200000401:0x5:0x0], intent: open flags 0320401 00010000:00010000:3.0:1747399860.994508:0:28317:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.994513:0:28317:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399860.994521:0:28317:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399860.994525:0:28317:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf676c0 x1832281081693888/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399860.994531:0:28317:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399860.994545:0:28317:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081693888:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399860.994612:0:28317:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399860.997262:0:28317:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081693888:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399860.997275:0:28317:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997294:0:28317:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997298:0:28317:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997303:0:28317:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997331:0:28317:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997337:0:28317:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b23a80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399860.997339:0:28317:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997345:0:28317:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997350:0:28317:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997355:0:28317:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399860.997358:0:28317:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399860.997362:0:28317:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdeef3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28317 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399860.997382:0:28317:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf676c0 x1832281081693888/t4294967313(4294967313) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399904 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399860.997391:0:28317:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf676c0 x1832281081693888/t4294967313(4294967313) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399904 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399860.997412:0:28317:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x6:0x0], updating i_size 512 00000080:00200000:3.0:1747399860.997415:0:28317:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6:0x0](ffff880136f91058): rc = 0 00000080:00010000:3.0:1747399860.997418:0:28317:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6:0x0](ffff880136f91058) for lock 0x0 00000080:00200000:3.0:1747399860.997432:0:28317:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), flags 320400 00000002:00100000:3.0:1747399860.997443:0:28317:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf676c0 x1832281081693888/t4294967313(4294967313) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399904 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399860.997491:0:28317:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), inode mode 41ed mask 44 00000080:00200000:3.0:1747399860.997522:0:28317:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), cmd=0x4008669a 00000020:00100000:3.0:1747399860.997555:0:28317:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399860.997560:0:28317:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf66880 x1832281081694016/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399860.997574:0:28317:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081694016:192.168.204.160@tcp:36:lfs.0 00000100:00100000:3.0:1747399860.997972:0:28317:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399861.003447:0:28317:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf66880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081694016:192.168.204.160@tcp:36:lfs.0 00000080:00200000:3.0:1747399861.003493:0:28317:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058) 00000002:00100000:3.0:1747399861.003521:0:28317:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf676c0 x1832281081693888/t4294967313(4294967313) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399904 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:3.0:1747399861.003541:0:28317:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399861.003544:0:28317:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf663c0 x1832281081694144/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399861.003571:0:28317:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081694144:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399861.003605:0:28317:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 6 seconds 00000100:00100000:3.0:1747399861.007344:0:28317:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28317:1832281081694144:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747399861.007365:0:28317:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf676c0 x1832281081693888/t4294967313(4294967313) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399904 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1747399861.015499:0:28318:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399861.015515:0:28318:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399861.015529:0:28318:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.015538:0:28318:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399861.015546:0:28318:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399861.015547:0:28318:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399861.015552:0:28318:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aae3bbb0 00010000:00010000:1.0:1747399861.015554:0:28318:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.015559:0:28318:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399861.015580:0:28318:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.015586:0:28318:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d6.ost-pools, flags=19 00000080:00200000:1.0:1747399861.015588:0:28318:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.015594:0:28318:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), file ffff88012b757500, open_flags 18800, mode 0 opened 0 00000080:00200000:1.0:1747399861.015598:0:28318:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open 00000002:00010000:1.0:1747399861.015605:0:28318:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir_tst,[0x0:0x0:0x0]) in obj [0x200000401:0x5:0x0], intent: open flags 0304001 00010000:00010000:1.0:1747399861.015640:0:28318:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.015646:0:28318:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399861.015655:0:28318:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399861.015663:0:28318:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6880 x1832281081694272/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399861.015670:0:28318:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399861.015685:0:28318:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694272:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399861.015793:0:28318:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399861.018894:0:28318:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694272:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399861.018907:0:28318:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018917:0:28318:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018931:0:28318:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018936:0:28318:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018940:0:28318:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018944:0:28318:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b180 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399861.018946:0:28318:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018951:0:28318:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018955:0:28318:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 5/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018960:0:28318:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399861.018963:0:28318:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.018967:0:28318:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdeefa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399861.018977:0:28318:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8801372e6880 x1832281081694272/t4294967316(4294967316) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399861.018992:0:28318:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6880 x1832281081694272/t4294967316(4294967316) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399861.019013:0:28318:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x6:0x0], updating i_size 512 00000080:00200000:1.0:1747399861.019015:0:28318:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6:0x0](ffff880136f91058): rc = 0 00000080:00010000:1.0:1747399861.019018:0:28318:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6:0x0](ffff880136f91058) for lock 0x0 00000080:00200000:1.0:1747399861.019042:0:28318:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), flags 304000 00000002:00100000:1.0:1747399861.019053:0:28318:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6880 x1832281081694272/t4294967316(4294967316) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399861.019097:0:28318:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), inode mode 41ed mask 44 00000080:00200000:1.0:1747399861.019118:0:28318:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399861.019126:0:28318:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399861.019133:0:28318:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.019140:0:28318:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399861.019145:0:28318:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399861.019147:0:28318:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399861.019149:0:28318:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aae3bbb0 00010000:00010000:1.0:1747399861.019151:0:28318:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.019155:0:28318:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399861.019164:0:28318:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.019170:0:28318:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d6.ost-pools, flags=16 00000080:00200000:1.0:1747399861.019172:0:28318:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.019179:0:28318:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), file ffff88012b756a80, open_flags 28800, mode 0 opened 0 00000080:00200000:1.0:1747399861.019182:0:28318:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open 00000002:00010000:1.0:1747399861.019188:0:28318:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir_tst,[0x0:0x0:0x0]) in obj [0x200000401:0x5:0x0], intent: open flags 0504001 00010000:00010000:1.0:1747399861.019216:0:28318:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.019221:0:28318:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399861.019228:0:28318:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399861.019232:0:28318:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6d40 x1832281081694400/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399861.019237:0:28318:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399861.019249:0:28318:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694400:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399861.019560:0:28318:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399861.021912:0:28318:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694400:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399861.021926:0:28318:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021936:0:28318:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021941:0:28318:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021956:0:28318:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021961:0:28318:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021965:0:28318:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b3c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399861.021967:0:28318:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021972:0:28318:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021977:0:28318:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021981:0:28318:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399861.021985:0:28318:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.021989:0:28318:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdef01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28318 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399861.021999:0:28318:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8801372e6d40 x1832281081694400/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399861.022008:0:28318:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6d40 x1832281081694400/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399861.022028:0:28318:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x6:0x0], updating i_size 512 00000080:00200000:1.0:1747399861.022048:0:28318:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6:0x0](ffff880136f91058): rc = 0 00000080:00010000:1.0:1747399861.022052:0:28318:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6:0x0](ffff880136f91058) for lock 0x0 00000080:00200000:1.0:1747399861.022067:0:28318:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), flags 504000 00000002:00100000:1.0:1747399861.022078:0:28318:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6d40 x1832281081694400/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399861.022091:0:28318:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e6d40 x1832281081694400/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1747399861.022109:0:28318:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399861.022112:0:28318:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e63c0 x1832281081694528/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399861.022126:0:28318:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694528:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399861.022173:0:28318:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399861.024479:0:28318:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694528:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399861.024498:0:28318:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e6d40 x1832281081694400/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399861.024572:0:28318:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), inode mode 41ed mask 44 00000080:00200000:1.0:1747399861.024594:0:28318:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058) 00000080:00200000:1.0:1747399861.024638:0:28318:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), cmd=0x4008669b 00000100:00100000:1.0:1747399861.024670:0:28318:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694592:192.168.204.160@tcp:33:lfs.0 00000100:00100000:1.0:1747399861.024716:0:28318:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399861.026679:0:28318:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694592:192.168.204.160@tcp:33:lfs.0 00000080:00200000:1.0:1747399861.026802:0:28318:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058) 00000002:00100000:1.0:1747399861.026823:0:28318:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e6880 x1832281081694272/t4294967316(4294967316) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747399861.026840:0:28318:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399861.026848:0:28318:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6d40 x1832281081694720/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399861.026860:0:28318:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694720:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399861.026891:0:28318:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399861.028730:0:28318:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28318:1832281081694720:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399861.028749:0:28318:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e6880 x1832281081694272/t4294967316(4294967316) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1747399861.037184:0:28320:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399861.037199:0:28320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399861.037211:0:28320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.037222:0:28320:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399861.037230:0:28320:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399861.037233:0:28320:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399861.037238:0:28320:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a991fbb0 00010000:00010000:1.0:1747399861.037240:0:28320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.037246:0:28320:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399861.037256:0:28320:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.037262:0:28320:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d6.ost-pools, flags=17 00000080:00200000:1.0:1747399861.037264:0:28320:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.037269:0:28320:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 3 00000080:00200000:1.0:1747399861.037275:0:28320:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), file ffff8800b6f39c80, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399861.037281:0:28320:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open|creat 00000002:00010000:1.0:1747399861.037292:0:28320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir_tst,[0x200000401:0x8:0x0]) in obj [0x200000401:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399861.037348:0:28320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.037354:0:28320:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399861.037364:0:28320:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399861.037371:0:28320:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6d40 x1832281081694848/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399861.037378:0:28320:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399861.037393:0:28320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081694848:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399861.037501:0:28320:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399861.042278:0:28320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081694848:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399861.042294:0:28320:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042306:0:28320:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042332:0:28320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042337:0:28320:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042349:0:28320:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042354:0:28320:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b600 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399861.042357:0:28320:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042361:0:28320:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042366:0:28320:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 5/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042371:0:28320:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399861.042374:0:28320:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042378:0:28320:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdef08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399861.042392:0:28320:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff8801372e6d40 x1832281081694848/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399861.042505:0:28320:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399861.042519:0:28320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399861.042530:0:28320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042539:0:28320:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399861.042552:0:28320:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399861.042555:0:28320:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399861.042559:0:28320:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a991fbb0 00010000:00010000:1.0:1747399861.042561:0:28320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042566:0:28320:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399861.042576:0:28320:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.042582:0:28320:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d6.ost-pools, flags=19 00000080:00200000:1.0:1747399861.042585:0:28320:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:1.0:1747399861.042591:0:28320:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), file ffff8800b6f39080, open_flags 1a100, mode 0 opened 0 00000080:00200000:1.0:1747399861.042595:0:28320:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open 00000002:00010000:1.0:1747399861.042602:0:28320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir_tst,[0x0:0x0:0x0]) in obj [0x200000401:0x5:0x0], intent: open flags 0320401 00010000:00010000:1.0:1747399861.042634:0:28320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.042639:0:28320:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399861.042648:0:28320:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399861.042652:0:28320:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6d40 x1832281081694976/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399861.042658:0:28320:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399861.042683:0:28320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081694976:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399861.042749:0:28320:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399861.047126:0:28320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081694976:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399861.047143:0:28320:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047153:0:28320:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047158:0:28320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047163:0:28320:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047168:0:28320:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047172:0:28320:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b840 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399861.047174:0:28320:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047178:0:28320:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047183:0:28320:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 5/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047199:0:28320:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399861.047202:0:28320:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.047206:0:28320:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdef0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28320 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399861.047218:0:28320:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8801372e6d40 x1832281081694976/t4294967320(4294967320) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399861.047227:0:28320:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6d40 x1832281081694976/t4294967320(4294967320) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399861.047248:0:28320:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x6:0x0], updating i_size 512 00000080:00200000:1.0:1747399861.047250:0:28320:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6:0x0](ffff880136f91058): rc = 0 00000080:00010000:1.0:1747399861.047253:0:28320:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6:0x0](ffff880136f91058) for lock 0x0 00000080:00200000:1.0:1747399861.047268:0:28320:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), flags 320400 00000002:00100000:1.0:1747399861.047280:0:28320:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6d40 x1832281081694976/t4294967320(4294967320) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399861.047347:0:28320:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), inode mode 41ed mask 44 00000080:00200000:1.0:1747399861.047373:0:28320:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058), cmd=0x4008669a 00000020:00100000:1.0:1747399861.047405:0:28320:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399861.047409:0:28320:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6880 x1832281081695104/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399861.047422:0:28320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081695104:192.168.204.160@tcp:36:lfs.0 00000100:00100000:1.0:1747399861.047553:0:28320:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399861.050088:0:28320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081695104:192.168.204.160@tcp:36:lfs.0 00000080:00200000:1.0:1747399861.050134:0:28320:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x6:0x0](ffff880136f91058) 00000002:00100000:1.0:1747399861.050159:0:28320:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e6d40 x1832281081694976/t4294967320(4294967320) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747399861.050177:0:28320:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399861.050181:0:28320:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e63c0 x1832281081695232/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399861.050193:0:28320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081695232:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399861.050223:0:28320:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399861.052221:0:28320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28320:1832281081695232:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399861.052242:0:28320:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e6d40 x1832281081694976/t4294967320(4294967320) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1747399861.057353:0:28321:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399861.057369:0:28321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399861.057380:0:28321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.057389:0:28321:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399861.057397:0:28321:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399861.057399:0:28321:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399861.057404:0:28321:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3abbbb0 00010000:00010000:3.0:1747399861.057405:0:28321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.057410:0:28321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399861.057421:0:28321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399861.057426:0:28321:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d6.ost-pools, flags=17 00000080:00200000:3.0:1747399861.057427:0:28321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 1 00000080:00200000:3.0:1747399861.057432:0:28321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x5:0x0](ffff880136f90898), inode mode 41ed mask 3 00000080:00200000:3.0:1747399861.057435:0:28321:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=file_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), file ffff88012a56ed80, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1747399861.057445:0:28321:0:(namei.c:833:ll_lookup_it()) VFS Op:name=file_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open|creat 00000002:00010000:3.0:1747399861.057456:0:28321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: file_tst,[0x200000401:0x9:0x0]) in obj [0x200000401:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1747399861.057494:0:28321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.057499:0:28321:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399861.057508:0:28321:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399861.057515:0:28321:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf663c0 x1832281081695360/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399861.057521:0:28321:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399861.057535:0:28321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081695360:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399861.057640:0:28321:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:3.0:1747399861.066564:0:28321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf663c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081695360:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399861.066584:0:28321:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066600:0:28321:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066606:0:28321:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066613:0:28321:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066635:0:28321:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066644:0:28321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066650:0:28321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066655:0:28321:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399861.066662:0:28321:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff88012bf663c0 x1832281081695360/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:3.0:1747399861.066672:0:28321:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf663c0 x1832281081695360/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1747399861.066680:0:28321:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.066687:0:28321:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/9 (0 0) 00000080:00200000:3.0:1747399861.066704:0:28321:0:(namei.c:1416:ll_create_it()) VFS Op:name=file_tst, dir=[0x200000401:0x5:0x0](ffff880136f90898), intent=open|creat 00000080:00200000:3.0:1747399861.066722:0:28321:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x9:0x0](ffff880136f91818) 00000080:00200000:3.0:1747399861.066727:0:28321:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x9:0x0], updating i_size 0 00000080:00200000:3.0:1747399861.067170:0:28321:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x9:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1747399861.067176:0:28321:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0x9:0x0](ffff880136f91818) 00000080:00010000:3.0:1747399861.067179:0:28321:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x9:0x0](ffff880136f91818) for lock 0xd95e55596abdef16 00000080:00200000:3.0:1747399861.067189:0:28321:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x9:0x0](ffff880136f91818), flags 120501 00000002:00100000:3.0:1747399861.067203:0:28321:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf663c0 x1832281081695360/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:3.0:1747399861.067253:0:28321:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdef16 from it ffff88012aae14e0 00010000:00010000:3.0:1747399861.067256:0:28321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.067262:0:28321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399861.067275:0:28321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x9:0x0](ffff880136f91818), inode mode 81a4 mask 40 00000080:00200000:3.0:1747399861.067303:0:28321:0:(file.c:4008:ll_file_ioctl()) VFS Op:inode=[0x200000401:0x9:0x0](ffff880136f91818), cmd=4008669a 00000002:00010000:3.0:1747399861.067340:0:28321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x9:0x0]) in obj [0x200000401:0x5:0x0], intent: open flags 040000002 00010000:00010000:3.0:1747399861.067376:0:28321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399861.067383:0:28321:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399861.067392:0:28321:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399861.067397:0:28321:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf676c0 x1832281081695488/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399861.067404:0:28321:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399861.067421:0:28321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081695488:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399861.070593:0:28321:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b480 going to sleep for 43 seconds 00000100:00100000:0.0:1747399861.074375:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399861.074440:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089200896 00000100:00100000:1.0:1747399861.074487:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 114 00000100:00100000:1.0:1747399861.074492:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:6705:x1832281089200896:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399861.074504:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399861.074568:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399861.074573:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:6705:x1832281089200896:12345-192.168.204.160@tcp:104: Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399861.074579:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 114 00010000:00010000:2.0:1747399861.074639:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399861.074643:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399861.074649:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b23cc0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399861.074652:0:4665:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399861.074658:0:4665:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399861.074663:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399861.074702:0:4665:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x9:0x0]: losing layout lock 00010000:00010000:2.0:1747399861.074735:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399861.074740:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399861.074769:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399861.074774:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23cc0/0xd95e55596abdef16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf605d55 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399861.074812:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399861.074813:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399861.074815:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399861.074828:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399861.074841:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081695552:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399861.077152:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081695552:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399861.812505:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399862.815526:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399863.563464:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399863.563468:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399863.563469:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399863.563471:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399863.563500:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081695680:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399863.563578:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399863.563584:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081695616:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399863.570814:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081695616:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399863.570829:0:1865:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967323 gen 1 00000100:00100000:2.0:1747399863.570853:0:1865:0:(client.c:2899:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff88012bf663c0 x1832281081695360/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000100:00100000:2.0:1747399863.570860:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081695680:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399863.817448:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399864.819695:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399865.821514:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399866.823793:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399867.826051:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399868.571476:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399868.571480:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399868.571482:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399868.571484:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399868.571508:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081695808:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399868.571584:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399868.571589:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081695744:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399868.575826:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081695808:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399868.577420:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081695744:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399868.827746:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399869.829734:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399870.831592:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399871.833496:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399872.836435:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399873.579492:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399873.579496:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399873.579499:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399873.579500:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399873.579524:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081695936:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399873.579615:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399873.579621:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081695872:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399873.582585:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081695872:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399873.582643:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081695936:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399873.837785:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399874.839552:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399875.842083:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399876.843917:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399877.846543:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399878.587745:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399878.587751:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399878.587753:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399878.587755:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399878.587787:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081696064:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399878.587890:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399878.587895:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081696000:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399878.589868:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081696064:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399878.589891:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081696000:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399878.847540:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399879.849565:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399880.852033:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399881.078866:0:28321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf676c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081695488:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399881.078890:0:28321:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078904:0:28321:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078909:0:28321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078915:0:28321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078921:0:28321:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078927:0:28321:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b23a80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399881.078930:0:28321:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078935:0:28321:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078941:0:28321:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 5/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078962:0:28321:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399881.078967:0:28321:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.078972:0:28321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b23a80/0xd95e55596abdef1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399881.079111:0:28321:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff88012bf676c0 x1832281081695488/t4294967324(4294967324) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/656 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399881.079121:0:28321:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf676c0 x1832281081695488/t4294967324(4294967324) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/656 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399881.079204:0:28321:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1747399881.079212:0:28321:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:3.0:1747399881.079219:0:28321:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1747399881.079221:0:28321:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:3.0:1747399881.079264:0:28321:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x9:0x0], updating i_size 0 00000002:00100000:3.0:1747399881.079280:0:28321:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf676c0 x1832281081695488/t4294967324(4294967324) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/656 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399881.079302:0:28321:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf676c0 x1832281081695488/t4294967324(4294967324) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/656 e 0 to 0 dl 1747399905 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:3.0:1747399881.079394:0:28321:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399881.079398:0:28321:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf650c0 x1832281081696192/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399881.079415:0:28321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081696192:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399881.079642:0:28321:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399881.081281:0:28321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf650c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081696192:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747399881.081308:0:28321:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf676c0 x1832281081695488/t4294967324(4294967324) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/656 e 0 to 0 dl 1747399905 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:3.0:1747399881.081363:0:28321:0:(file.c:6088:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000401:0x9:0x0](ffff880136f91818) 00000002:00010000:3.0:1747399881.081372:0:28321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x9:0x0]) in obj [0x200000401:0x9:0x0], intent: layout flags 0 00010000:00010000:3.0:1747399881.081415:0:28321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.081423:0:28321:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.081431:0:28321:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1747399881.081448:0:28321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081696256:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399881.081510:0:28321:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 43 seconds 00000100:00100000:3.0:1747399881.083465:0:28321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081696256:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399881.083494:0:28321:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.083506:0:28321:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00000002:00100000:3.0:1747399881.083517:0:28321:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff88012bf65f00 x1832281081696256/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 376/400 e 0 to 0 dl 1747399925 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1747399881.083525:0:28321:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00000002:00010000:3.0:1747399881.083553:0:28321:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.083563:0:28321:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/9 (0 0) 00000080:00010000:3.0:1747399881.083583:0:28321:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x9:0x0](ffff880136f91818) for lock 0xd95e55596abdef24 00000080:00010000:3.0:1747399881.083593:0:28321:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdef24 from it ffff8800b3abbbf8 00010000:00010000:3.0:1747399881.083596:0:28321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.083604:0:28321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.083629:0:28321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.083638:0:28321:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00000080:00010000:3.0:1747399881.083644:0:28321:0:(file.c:5976:ll_layout_lock_set()) ### file [0x200000401:0x9:0x0](ffff880136f91818) being reconfigured ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1747399881.083693:0:28321:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x9:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:3.0:1747399881.083697:0:28321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399881.083702:0:28321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b233c0/0xd95e55596abdef24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf605d78 expref: -99 pid: 28321 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1747399881.083772:0:28321:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x9:0x0](ffff880136f91818) 00000002:00100000:3.0:1747399881.083798:0:28321:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf663c0 x1832281081695360/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:3.0:1747399881.083822:0:28321:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399881.083827:0:28321:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf65f00 x1832281081696384/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399881.083846:0:28321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081696384:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399881.083923:0:28321:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399881.085515:0:28321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:28321:1832281081696384:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399881.085549:0:28321:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf663c0 x1832281081695360/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399905 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000100:00100000:0.0:1747399881.440303:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399881.440367:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089202752 00000100:00100000:0.0:1747399881.440368:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399881.440387:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089202816 00000100:00100000:1.0:1747399881.440394:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 115 00000100:00100000:1.0:1747399881.440399:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:1650:x1832281089202752:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399881.440411:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399881.440472:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399881.440475:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:1650:x1832281089202752:12345-192.168.204.160@tcp:104: Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399881.440480:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 115 00000100:00100000:1.0:1747399881.440490:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 116 00000100:00100000:1.0:1747399881.440493:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:1650:x1832281089202816:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399881.440498:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399881.440522:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399881.440525:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:1650:x1832281089202816:12345-192.168.204.160@tcp:104: Request processed in 32us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399881.440528:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 116 00010000:00010000:2.0:1747399881.440689:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399881.440694:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399881.440705:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5200 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399881.440709:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399881.440714:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399881.440718:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399881.440722:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399881.440727:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399881.440734:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.440745:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4fc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399881.440747:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.440754:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399881.440758:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399881.440760:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399881.440762:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399881.440776:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399881.440792:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399881.440796:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdeed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605c3d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.440797:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.440802:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399881.440808:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399881.440809:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399881.440810:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399881.440810:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399881.440823:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081696512:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399881.440826:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdeed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605c36 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399881.440845:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399881.440845:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399881.440847:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399881.440862:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081696448:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399881.442748:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081696512:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399881.442785:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081696448:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399881.853547:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399882.855695:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399883.369419:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399883.369425:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 254 10000000:01000000:0.0:1747399883.369430:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399883.369473:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399883.369481:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399883.369490:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399883.369513:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399883.369633:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67539c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399883.372628:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399883.372659:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399883.372668:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399883.372728:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399883.372786:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399883.375822:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399883.375866:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696704:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399883.376301:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399883.379004:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696704:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399883.379378:0:28350:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28350:1832281081696768:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399883.379440:0:28350:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399883.383363:0:28350:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28350:1832281081696768:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399883.383405:0:28350:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399883.383413:0:28350:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399883.383414:0:28350:0:(obd_config.c:1460:class_process_config()) marker 167 (0x1) lustre-clilov new lustre.testpool2 00000020:01000000:3.0:1747399883.383418:0:28350:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399883.383420:0:28350:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399883.383435:0:28350:0:(lov_pool.c:313:lov_pool_new()) testpool2 is pool #2 00000100:00100000:3.0:1747399883.383463:0:28350:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28350:1832281081696832:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399883.383601:0:28350:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747399883.385879:0:28350:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28350:1832281081696832:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399883.385926:0:28350:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399883.385934:0:28350:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399883.385935:0:28350:0:(obd_config.c:1460:class_process_config()) marker 167 (0x2) lustre-clilov new lustre.testpool2 00000040:00080000:3.0:1747399883.385950:0:28350:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 257 count 252 00000020:01000000:2.0:1747399883.386116:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 254-256 (rc=0) 10000000:01000000:2.0:1747399883.386140:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399883.386148:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399883.386159:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399883.386169:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399883.386171:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399883.386174:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399883.386277:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399883.386283:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399883.386297:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399883.386344:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696896:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399883.386397:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399883.388485:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696896:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399883.388505:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399883.388514:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399883.388578:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696960:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399883.388636:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399883.391085:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081696960:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399883.391128:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399883.391134:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399883.391144:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399883.595460:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399883.595466:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399883.595467:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399883.595481:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399883.595496:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399883.595512:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081697024:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399883.597551:0:1865:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967326 gen 1 00000100:00100000:2.0:1747399883.597648:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081697024:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399883.857458:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399884.145414:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399884.145466:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399884.145504:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1747399884.145524:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089206080 00000100:00100000:0.0:1747399884.145558:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089206144 00000100:00100000:0.0:1747399884.145566:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 117 00000100:00100000:0.0:1747399884.145571:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:1852:x1832281089206080:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399884.145585:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399884.145661:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399884.145665:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:1852:x1832281089206080:12345-192.168.204.160@tcp:104: Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399884.145671:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 117 00000100:00100000:0.0:1747399884.145683:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 118 00000100:00100000:0.0:1747399884.145686:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:1852:x1832281089206144:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399884.145699:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399884.145725:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399884.145728:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:1852:x1832281089206144:12345-192.168.204.160@tcp:104: Request processed in 42us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399884.145732:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 118 00010000:00010000:2.0:1747399884.145789:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399884.145798:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145808:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4fc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399884.145811:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145818:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399884.145822:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399884.145825:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399884.145868:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145872:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399884.145886:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145891:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdef32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605de1 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145916:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399884.145918:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145922:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399884.145924:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145928:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399884.145931:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399884.145936:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399884.145944:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145947:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399884.145950:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.145953:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdef2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605dda expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399884.145962:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399884.145963:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399884.145964:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399884.145965:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399884.145989:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081697088:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399884.146047:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399884.146055:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081697152:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399884.148461:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081697152:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399884.148477:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081697088:192.168.204.160@tcp:103:ldlm_bl_01.0 10000000:01000000:2.0:1747399884.590446:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399884.590451:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 257 10000000:01000000:2.0:1747399884.590455:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399884.590490:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.590498:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.590506:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399884.590525:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697216:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399884.590966:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399884.594205:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697216:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399884.594223:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.594232:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399884.594281:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697280:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399884.594336:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399884.596467:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697280:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399884.596512:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697344:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399884.597277:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399884.599031:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697344:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399884.599929:0:28391:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28391:1832281081697408:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399884.599988:0:28391:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399884.602643:0:28391:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28391:1832281081697408:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399884.602674:0:28391:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399884.602682:0:28391:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399884.602683:0:28391:0:(obd_config.c:1460:class_process_config()) marker 169 (0x1) lustre-clilov add lustre.testpool2.lustre-OST0000_UUID 00000020:01000000:3.0:1747399884.602689:0:28391:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399884.602691:0:28391:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399884.602701:0:28391:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool2 as member 1 00000100:00100000:3.0:1747399884.602724:0:28391:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28391:1832281081697472:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399884.602770:0:28391:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399884.604988:0:28391:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28391:1832281081697472:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399884.605013:0:28391:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399884.605018:0:28391:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399884.605019:0:28391:0:(obd_config.c:1460:class_process_config()) marker 169 (0x2) lustre-clilov add lustre.testpool2.lustre-OST0000_UUID 00000040:00080000:3.0:1747399884.605023:0:28391:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 260 count 255 00000020:01000000:2.0:1747399884.605390:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 257-259 (rc=0) 10000000:01000000:2.0:1747399884.605408:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399884.605414:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.605422:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399884.605430:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399884.605432:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399884.605434:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399884.605453:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.605459:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.605466:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399884.605477:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697536:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399884.605510:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399884.607072:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697536:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399884.607089:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.607106:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399884.607147:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697600:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399884.607266:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399884.608715:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697600:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399884.608737:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399884.608741:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399884.608748:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399884.860010:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399885.861398:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399886.863469:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399887.865555:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399887.960132:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399887.960292:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399887.960357:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089210112 00000100:00100000:1.0:1747399887.960370:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089210240 00000100:00100000:0.0:1747399887.960392:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 119 00000100:00100000:0.0:1747399887.960397:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:2316:x1832281089210240:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399887.960412:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960746:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399887.960751:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:2316:x1832281089210240:12345-192.168.204.160@tcp:104: Request processed in 354us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399887.960758:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 119 00010000:00010000:2.0:1747399887.960759:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399887.960767:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399887.960773:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 120 00010000:00010000:2.0:1747399887.960774:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f58c0 already unused, calling callback (ffffffffa05055c0) 00000100:00100000:0.0:1747399887.960776:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:2316:x1832281089210112:12345-192.168.204.160@tcp:104: 10000000:00010000:2.0:1747399887.960777:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960780:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399887.960783:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399887.960789:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399887.960793:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399887.960815:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399887.960819:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:2316:x1832281089210112:12345-192.168.204.160@tcp:104: Request processed in 43us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399887.960829:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 120 00010000:00010000:2.0:1747399887.960847:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960847:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1747399887.960850:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399887.960853:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1747399887.960854:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:0.0:1747399887.960856:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960859:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1747399887.960863:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399887.960866:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399887.960869:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399887.960874:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1747399887.960874:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdef39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605dfd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960879:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960882:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399887.960886:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399887.960887:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399887.960888:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399887.960891:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081697664:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1747399887.960891:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960895:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e04 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399887.960906:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399887.960906:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399887.960907:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399887.960911:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1747399887.960918:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081697728:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1747399887.962445:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081697728:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399887.962538:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaf200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081697664:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00080000:2.0:1747399888.603799:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399888.603804:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399888.603805:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399888.603807:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399888.603831:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081697856:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399888.603885:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081697792:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399888.606162:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081697792:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399888.606360:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081697856:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399888.867601:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399889.156451:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399889.156459:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 260 10000000:01000000:3.0:1747399889.156464:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399889.156542:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399889.156551:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399889.156562:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399889.156587:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697920:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399889.156679:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399889.161667:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697920:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399889.161696:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399889.161707:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399889.161780:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697984:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399889.161848:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399889.164036:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081697984:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399889.164082:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698048:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399889.164139:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399889.167430:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698048:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399889.168486:0:28902:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28902:1832281081698112:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399889.168562:0:28902:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399889.171924:0:28902:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28902:1832281081698112:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399889.171962:0:28902:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399889.171970:0:28902:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399889.171971:0:28902:0:(obd_config.c:1460:class_process_config()) marker 171 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399889.171976:0:28902:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399889.171978:0:28902:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399889.171988:0:28902:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:3.0:1747399889.172013:0:28902:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28902:1832281081698176:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399889.172070:0:28902:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399889.176401:0:28902:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28902:1832281081698176:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399889.176437:0:28902:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399889.176442:0:28902:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399889.176443:0:28902:0:(obd_config.c:1460:class_process_config()) marker 171 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399889.176446:0:28902:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 263 count 258 00000020:01000000:0.0:1747399889.178557:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 260-262 (rc=0) 10000000:01000000:0.0:1747399889.178580:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399889.178585:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399889.178594:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399889.178601:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399889.178604:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399889.178606:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399889.178628:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399889.178632:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399889.178639:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399889.178656:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698240:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399889.178719:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399889.179955:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698240:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399889.179969:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399889.179976:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399889.180017:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698304:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399889.180053:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399889.180668:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698304:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399889.180688:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399889.180691:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399889.180697:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399889.869943:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399890.303633:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399890.303683:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399890.303720:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089212736 00000100:00100000:0.0:1747399890.303745:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089213056 00000100:00100000:0.0:1747399890.303753:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 121 00000100:00100000:0.0:1747399890.303757:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:2408:x1832281089212736:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399890.303776:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399890.303838:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399890.303843:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:2408:x1832281089212736:12345-192.168.204.160@tcp:104: Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399890.303848:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 121 00000100:00100000:0.0:1747399890.303860:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 122 00000100:00100000:0.0:1747399890.303863:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:2408:x1832281089213056:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399890.303867:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399890.303898:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399890.303902:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:2408:x1832281089213056:12345-192.168.204.160@tcp:104: Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399890.303906:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 122 00010000:00010000:3.0:1747399890.303967:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399890.303971:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399890.303977:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2d00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399890.303980:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399890.303985:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399890.303987:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399890.303991:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399890.303998:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b23180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399890.303999:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399890.303999:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399890.304003:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399890.304004:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399890.304008:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399890.304011:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399890.304043:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399890.304043:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399890.304047:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399890.304048:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399890.304059:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399890.304060:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399890.304064:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdef4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e7b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399890.304068:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b23180/0xd95e55596abdef47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605e74 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399890.304075:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399890.304076:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399890.304077:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399890.304081:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399890.304082:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399890.304084:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399890.304089:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081698368:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399890.304092:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081698432:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399890.305775:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aadf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081698368:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399890.305833:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf65580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081698432:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399890.873021:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399891.174971:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399891.174976:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 263 10000000:01000000:0.0:1747399891.174981:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399891.175024:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399891.175032:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399891.175042:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399891.175062:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698496:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399891.175143:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67530c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399891.183502:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698496:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399891.183524:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.183533:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399891.183598:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698560:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399891.183667:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399891.188509:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698560:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399891.188557:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698624:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399891.189127:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399891.191106:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698624:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399891.191505:0:28913:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28913:1832281081698688:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399891.191565:0:28913:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399891.193522:0:28913:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28913:1832281081698688:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399891.193554:0:28913:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399891.193561:0:28913:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399891.193562:0:28913:0:(obd_config.c:1460:class_process_config()) marker 173 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747399891.193567:0:28913:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399891.193569:0:28913:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399891.193584:0:28913:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:3.0:1747399891.193621:0:28913:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28913:1832281081698752:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399891.193671:0:28913:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399891.194831:0:28913:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28913:1832281081698752:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399891.194851:0:28913:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399891.194856:0:28913:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399891.194857:0:28913:0:(obd_config.c:1460:class_process_config()) marker 173 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747399891.194860:0:28913:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 267 count 261 00000020:01000000:2.0:1747399891.194993:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 263-266 (rc=0) 10000000:01000000:2.0:1747399891.195023:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399891.195029:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.195038:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399891.195044:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399891.195047:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399891.195048:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399891.195077:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.195083:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.195089:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399891.195100:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399891.195140:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399891.196439:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399891.196454:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.196462:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399891.196520:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399891.196558:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:3.0:1747399891.197691:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081698880:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747399891.197718:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747399891.197722:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.197729:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.875579:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399891.990874:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399891.990930:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399891.990980:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089214976 00000100:00100000:0.0:1747399891.991014:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089215040 00000100:00100000:0.0:1747399891.991024:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 123 00000100:00100000:0.0:1747399891.991029:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:2548:x1832281089214976:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399891.991044:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399891.991342:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399891.991348:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:2548:x1832281089214976:12345-192.168.204.160@tcp:104: Request processed in 318us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399891.991354:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 123 00000100:00100000:0.0:1747399891.991368:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 124 00000100:00100000:0.0:1747399891.991371:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:2548:x1832281089215040:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399891.991377:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399891.991407:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399891.991410:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:2548:x1832281089215040:12345-192.168.204.160@tcp:104: Request processed in 38us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399891.991414:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 124 00010000:00010000:2.0:1747399891.991488:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399891.991493:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.991499:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399891.991502:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.991507:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.991508:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1747399891.991512:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.991516:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399891.991516:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399891.991525:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399891.991528:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.991534:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399891.991539:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399891.991552:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399891.991556:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.991561:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399891.991578:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.991582:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.991582:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605f54 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.991586:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399891.991596:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399891.991600:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdef55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605f4d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399891.991600:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399891.991601:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399891.991602:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399891.991616:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081699008:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399891.991620:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399891.991622:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399891.991623:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399891.991638:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081698944:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399891.993034:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081698944:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399891.993134:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081699008:192.168.204.160@tcp:103:ldlm_bl_03.0 10000000:01000000:0.0:1747399892.260408:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399892.260413:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 267 10000000:01000000:0.0:1747399892.260417:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399892.260480:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399892.260498:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399892.260506:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399892.260530:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699072:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399892.260603:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399892.264163:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699072:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399892.264206:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399892.264218:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399892.264382:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699136:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399892.264478:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399892.267056:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699136:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399892.267113:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699200:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399892.267200:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399892.269815:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699200:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399892.270086:0:28932:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28932:1832281081699264:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399892.270156:0:28932:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399892.272383:0:28932:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28932:1832281081699264:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399892.272456:0:28932:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399892.272465:0:28932:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399892.272466:0:28932:0:(obd_config.c:1460:class_process_config()) marker 175 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399892.272472:0:28932:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399892.272474:0:28932:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399892.272537:0:28932:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28932:1832281081699328:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399892.272621:0:28932:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399892.275151:0:28932:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28932:1832281081699328:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399892.275192:0:28932:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399892.275199:0:28932:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399892.275200:0:28932:0:(obd_config.c:1460:class_process_config()) marker 175 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399892.275204:0:28932:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 270 count 264 00000020:01000000:2.0:1747399892.275398:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 267-269 (rc=0) 10000000:01000000:2.0:1747399892.275428:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399892.275435:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399892.275458:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399892.275467:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399892.275470:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399892.275472:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399892.275499:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399892.275505:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399892.275521:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399892.275546:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399892.275618:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399892.276888:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699392:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399892.276902:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399892.276909:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399892.276949:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699456:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399892.276982:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399892.278022:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699456:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399892.278043:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399892.278047:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399892.278052:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399892.877753:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399893.611527:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399893.611532:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399893.611534:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399893.611545:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399893.611575:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081699584:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399893.611659:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399893.611663:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081699520:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399893.613124:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081699520:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399893.613141:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081699584:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399893.879553:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399894.392803:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399894.392859:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399894.392881:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399894.392905:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089218240 00000100:00100000:1.0:1747399894.392948:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 125 00000100:00100000:1.0:1747399894.392954:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ab47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:2837:x1832281089218240:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399894.392968:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399894.393037:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1747399894.393042:0:4657:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089218304 00000100:00100000:1.0:1747399894.393042:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ab47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:2837:x1832281089218240:12345-192.168.204.160@tcp:104: Request processed in 88us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399894.393059:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 125 00000100:00100000:2.0:1747399894.393066:0:4657:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 10 00000100:00100000:2.0:1747399894.393070:0:4657:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:2837:x1832281089218304:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399894.393076:0:4657:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399894.393103:0:4657:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1747399894.393107:0:4657:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:2837:x1832281089218304:12345-192.168.204.160@tcp:104: Request processed in 37us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1747399894.393112:0:4657:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 10 00010000:00010000:2.0:1747399894.393132:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399894.393137:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399894.393143:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399894.393145:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399894.393160:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399894.393165:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399894.393169:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399894.393201:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399894.393206:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399894.393221:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399894.393243:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399894.393248:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399894.393255:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399894.393256:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399894.393261:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399894.393266:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399894.393270:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399894.393296:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399894.393301:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399894.393305:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399894.393342:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdef63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605fc4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399894.393358:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399894.393365:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399894.393366:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399894.393382:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081699648:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399894.393441:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399894.393446:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081699712:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399894.393975:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdef6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf605fcb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399894.393990:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399894.393991:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399894.393993:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399894.396268:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081699712:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399894.396280:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081699648:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399894.881971:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399895.861913:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399895.861919:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 270 10000000:01000000:1.0:1747399895.861923:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399895.861957:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.861965:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.861974:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399895.861994:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699776:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399895.862061:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:1.0:1747399895.867398:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699776:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399895.867420:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.867430:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399895.867490:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699840:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399895.867552:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:1.0:1747399895.869839:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699840:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399895.869905:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699904:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399895.870053:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:1.0:1747399895.871587:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081699904:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399895.872209:0:28997:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28997:1832281081699968:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399895.872280:0:28997:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399895.875039:0:28997:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28997:1832281081699968:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399895.875083:0:28997:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399895.875093:0:28997:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399895.875094:0:28997:0:(obd_config.c:1460:class_process_config()) marker 177 (0x1) lustre-clilov rem lustre.testpool2.lustre-OST0000_UUID 00000020:01000000:3.0:1747399895.875100:0:28997:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399895.875102:0:28997:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399895.875114:0:28997:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool2 00000100:00100000:3.0:1747399895.875144:0:28997:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28997:1832281081700032:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399895.875205:0:28997:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399895.877269:0:28997:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:28997:1832281081700032:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399895.877360:0:28997:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399895.877366:0:28997:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399895.877368:0:28997:0:(obd_config.c:1460:class_process_config()) marker 177 (0x2) lustre-clilov rem lustre.testpool2.lustre-OST0000_UUID 00000040:00080000:3.0:1747399895.877371:0:28997:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 273 count 267 00000020:01000000:1.0:1747399895.877642:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 270-272 (rc=0) 10000000:01000000:1.0:1747399895.877663:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399895.877670:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.877680:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399895.877689:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399895.877692:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399895.877694:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399895.877723:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.877729:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.877736:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399895.877751:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700096:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399895.877813:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:1.0:1747399895.880281:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700096:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399895.880353:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.880365:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399895.880460:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700160:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399895.880519:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:1.0:1747399895.882207:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700160:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399895.882248:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399895.882255:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399895.882263:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399895.883487:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399896.885567:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399897.045834:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399897.045881:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399897.045904:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089221056 00000100:00100000:0.0:1747399897.045911:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089221120 00000100:00100000:1.0:1747399897.045931:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 126 00000100:00100000:1.0:1747399897.045936:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:2996:x1832281089221056:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399897.045947:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.047054:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399897.047062:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:2996:x1832281089221056:12345-192.168.204.160@tcp:104: Request processed in 1124us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399897.047069:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 126 00000100:00100000:1.0:1747399897.047084:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 127 00000100:00100000:1.0:1747399897.047087:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:2996:x1832281089221120:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399897.047093:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.047142:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399897.047145:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:2996:x1832281089221120:12345-192.168.204.160@tcp:104: Request processed in 57us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399897.047149:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 127 00010000:00010000:2.0:1747399897.047294:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399897.047298:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047305:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45bcc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399897.047307:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047329:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399897.047339:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399897.047342:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399897.047378:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047384:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399897.047395:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047400:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606042 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047414:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399897.047416:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047420:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45ba80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399897.047421:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047426:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399897.047430:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399897.047433:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399897.047440:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047450:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399897.047453:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047458:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60603b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.047466:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399897.047467:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399897.047468:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399897.047491:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081700224:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399897.047523:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399897.047527:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081700288:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399897.047545:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399897.048725:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081700288:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399897.048734:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081700224:192.168.204.160@tcp:103:ldlm_bl_01.0 10000000:01000000:1.0:1747399897.849416:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399897.849423:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 273 10000000:01000000:1.0:1747399897.849432:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399897.849481:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.849491:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.849499:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399897.849520:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399897.849639:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399897.851663:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399897.851681:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.851689:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399897.851740:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700416:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399897.851780:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399897.852704:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700416:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399897.852727:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700480:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399897.853362:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399897.856743:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700480:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399897.857085:0:29016:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29016:1832281081700544:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399897.857224:0:29016:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399897.859227:0:29016:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29016:1832281081700544:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399897.859260:0:29016:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399897.859267:0:29016:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399897.859268:0:29016:0:(obd_config.c:1460:class_process_config()) marker 179 (0x1) lustre-clilov del lustre.testpool2 00000020:01000000:3.0:1747399897.859273:0:29016:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399897.859275:0:29016:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399897.859381:0:29016:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29016:1832281081700608:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399897.859445:0:29016:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5ba80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399897.863215:0:29016:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29016:1832281081700608:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399897.863254:0:29016:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399897.863260:0:29016:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399897.863262:0:29016:0:(obd_config.c:1460:class_process_config()) marker 179 (0x2) lustre-clilov del lustre.testpool2 00000040:00080000:3.0:1747399897.863266:0:29016:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 276 count 270 00000020:01000000:1.0:1747399897.863510:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 273-275 (rc=0) 10000000:01000000:1.0:1747399897.863534:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399897.863541:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.863550:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399897.863557:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399897.863559:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399897.863561:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399897.863582:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.863587:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.863593:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399897.863606:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700672:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399897.864099:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399897.865879:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700672:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399897.865904:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.865920:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399897.865979:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700736:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399897.866032:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399897.867076:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081700736:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399897.867105:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399897.867111:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399897.867118:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399897.887720:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399898.619962:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399898.619966:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399898.619967:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399898.619969:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399898.619993:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081700864:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399898.620065:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399898.620070:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081700800:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399898.629023:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081700864:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399898.630519:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081700800:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399898.890307:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399899.891476:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399899.943774:0:29192:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399899.943777:0:29192:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 7a: create various pool name =========== 08:51:39 (1747399899) 00000080:00200000:3.0:1747399899.977879:0:29207:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399899.977902:0:29207:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399899.977918:0:29207:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.977932:0:29207:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399899.977943:0:29207:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399899.977949:0:29207:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399899.977955:0:29207:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9affe00 00010000:00010000:3.0:1747399899.977958:0:29207:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.977964:0:29207:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399899.977980:0:29207:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:3.0:1747399899.977988:0:29207:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399899.977992:0:29207:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399899.977996:0:29207:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.978001:0:29207:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399899.978006:0:29207:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399899.978007:0:29207:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399899.978009:0:29207:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9affb58 00010000:00010000:3.0:1747399899.978011:0:29207:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.978016:0:29207:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399899.978022:0:29207:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399899.978028:0:29207:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d7a.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1536 00000080:00200000:3.0:1747399899.978031:0:29207:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399899.978039:0:29207:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399899.978043:0:29207:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.978048:0:29207:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399899.978053:0:29207:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399899.978055:0:29207:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399899.978057:0:29207:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9affbf0 00010000:00010000:3.0:1747399899.978058:0:29207:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.978063:0:29207:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399899.978069:0:29207:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399899.978072:0:29207:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399899.978075:0:29207:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399899.978078:0:29207:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.978083:0:29207:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399899.978088:0:29207:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399899.978089:0:29207:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399899.978091:0:29207:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9affda0 00010000:00010000:3.0:1747399899.978092:0:29207:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399899.978101:0:29207:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399899.978108:0:29207:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399899.978111:0:29207:0:(namei.c:1935:ll_mkdir()) VFS Op:name=d7a.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8) 00800000:00000004:3.0:1747399899.978126:0:29207:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800b65c8800: age 136, max_age 0 00000100:00100000:2.0:1747399899.978241:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081700928:192.168.204.160@tcp:41:mkdir.0 00000020:00100000:3.0:1747399899.978417:0:29207:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399899.978424:0:29207:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf63900 x1832281081701056/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399899.978438:0:29207:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29207:1832281081701056:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:3.0:1747399899.978457:0:29207:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 43 seconds 00000100:00100000:3.0:1747399899.980917:0:29207:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63900 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29207:1832281081701056:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:2.0:1747399899.980939:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081700928:192.168.204.160@tcp:41:mkdir.0 00000080:00200000:3.0:1747399899.981054:0:29207:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8) 00000080:00200000:3.0:1747399899.981060:0:29207:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xa:0x0], updating i_size 512 00000100:00100000:0.0:1747399900.290456:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399900.290569:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089225024 00000100:00100000:1.0:1747399900.290609:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 128 00000100:00100000:1.0:1747399900.290613:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:3228:x1832281089225024:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399900.290623:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399900.290678:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399900.290682:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:3228:x1832281089225024:12345-192.168.204.160@tcp:104: Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399900.290687:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 128 00010000:00010000:2.0:1747399900.290915:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399900.290920:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.290926:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45bcc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399900.290928:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.290934:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399900.290938:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399900.290942:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399900.290974:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.290979:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399900.291003:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.291020:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdef86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606057 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.291044:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399900.291045:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399900.291047:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399900.291053:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399900.291066:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701120:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1747399900.291553:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399900.291574:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089225280 00000100:00100000:0.0:1747399900.291591:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 129 00000100:00100000:0.0:1747399900.291594:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:3228:x1832281089225280:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399900.291600:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399900.291637:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399900.291641:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:3228:x1832281089225280:12345-192.168.204.160@tcp:104: Request processed in 46us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399900.291646:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 129 00010000:00010000:2.0:1747399900.291722:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399900.291726:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.291732:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45ba80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399900.291733:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.291738:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399900.291743:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399900.291746:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399900.291774:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.291779:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399900.291801:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.291813:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdef7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606050 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399900.291823:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399900.291825:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399900.291826:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399900.291840:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701184:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399900.293356:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701120:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399900.293941:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701184:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399900.894067:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399901.897127:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399902.247407:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399902.247412:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 276 10000000:01000000:1.0:1747399902.247416:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399902.247461:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399902.247469:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399902.247477:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399902.247499:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701248:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399902.247568:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399902.249504:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701248:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399902.249523:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399902.249531:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399902.249588:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701312:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399902.249619:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399902.251723:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701312:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399902.251764:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701376:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399902.251876:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399902.255456:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701376:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399902.256149:0:29230:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29230:1832281081701440:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399902.256212:0:29230:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399902.259216:0:29230:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29230:1832281081701440:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399902.259274:0:29230:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399902.259282:0:29230:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399902.259283:0:29230:0:(obd_config.c:1460:class_process_config()) marker 181 (0x1) lustre-clilov new lustre.6 00000020:01000000:3.0:1747399902.259288:0:29230:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399902.259290:0:29230:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399902.259305:0:29230:0:(lov_pool.c:313:lov_pool_new()) 6 is pool #1 00000100:00100000:3.0:1747399902.259368:0:29230:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29230:1832281081701504:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399902.259426:0:29230:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747399902.262207:0:29230:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29230:1832281081701504:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399902.262252:0:29230:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399902.262274:0:29230:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399902.262277:0:29230:0:(obd_config.c:1460:class_process_config()) marker 181 (0x2) lustre-clilov new lustre.6 00000040:00080000:3.0:1747399902.262280:0:29230:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 279 count 273 00000020:01000000:1.0:1747399902.262628:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 276-278 (rc=0) 10000000:01000000:1.0:1747399902.262649:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399902.262656:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399902.262675:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399902.262685:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399902.262688:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399902.262690:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399902.262720:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399902.262726:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399902.262734:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399902.262751:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701568:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399902.262827:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:0.0:1747399902.267549:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701568:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1747399902.267581:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399902.267590:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399902.267651:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701632:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747399902.267906:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753e40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399902.269497:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701632:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399902.269535:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399902.269540:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399902.269552:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399902.899520:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399903.003416:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399903.003460:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399903.003491:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089227584 00000100:00100000:0.0:1747399903.003491:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089227648 00000100:00100000:0.0:1747399903.003516:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 130 00000100:00100000:0.0:1747399903.003520:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:3414:x1832281089227584:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399903.003531:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399903.003597:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399903.003601:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:3414:x1832281089227584:12345-192.168.204.160@tcp:104: Request processed in 81us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399903.003607:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 130 00000100:00100000:0.0:1747399903.003620:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 131 00000100:00100000:0.0:1747399903.003623:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:3414:x1832281089227648:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399903.003628:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399903.003657:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399903.003660:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:3414:x1832281089227648:12345-192.168.204.160@tcp:104: Request processed in 36us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399903.003671:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 131 00010000:00010000:2.0:1747399903.003683:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399903.003740:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399903.003796:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b600 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399903.003798:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399903.003804:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399903.003808:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399903.003814:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399903.003815:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399903.003821:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399903.003826:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399903.003830:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399903.003853:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399903.003857:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399903.003861:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399903.003942:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399903.003946:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399903.003960:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399903.003964:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdef8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606137 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399903.003977:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399903.003978:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399903.003983:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399903.003994:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081701696:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399903.004040:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399903.004087:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399903.004095:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399903.004100:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45b600/0xd95e55596abdef94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60613e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399903.004114:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399903.004170:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399903.004222:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399903.004230:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701760:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399903.007080:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701760:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399903.007881:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081701696:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00080000:2.0:1747399903.628957:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399903.628962:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399903.628963:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399903.628965:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399903.628989:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081701888:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399903.629079:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399903.629084:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701824:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399903.632702:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081701824:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399903.633217:0:1864:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967327 gen 1 00000100:00100000:2.0:1747399903.633228:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081701888:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399903.901490:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399904.045371:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399904.045375:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 279 10000000:01000000:0.0:1747399904.045379:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399904.045412:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399904.045420:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399904.045428:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399904.045449:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701952:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399904.045508:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753e40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399904.058694:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081701952:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399904.058715:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.058729:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399904.058788:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702016:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399904.058845:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.061325:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf64280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702016:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399904.061368:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702080:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399904.061427:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.063931:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702080:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399904.064523:0:29286:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29286:1832281081702144:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399904.064600:0:29286:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e840 going to sleep for 6 seconds 00000100:00100000:1.0:1747399904.066899:0:29286:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29286:1832281081702144:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399904.066938:0:29286:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399904.066945:0:29286:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399904.066946:0:29286:0:(obd_config.c:1460:class_process_config()) marker 183 (0x1) lustre-clilov add lustre.6.lustre-OST0000_UUID 00000020:01000000:1.0:1747399904.066951:0:29286:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399904.066952:0:29286:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1747399904.066961:0:29286:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to 6 as member 1 00000020:01000000:1.0:1747399904.066964:0:29286:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399904.066970:0:29286:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399904.066971:0:29286:0:(obd_config.c:1460:class_process_config()) marker 183 (0x2) lustre-clilov add lustre.6.lustre-OST0000_UUID 00000020:01000000:1.0:1747399904.066972:0:29286:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399904.066974:0:29286:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399904.066974:0:29286:0:(obd_config.c:1460:class_process_config()) marker 185 (0x1) lustre-clilov add lustre.6.lustre-OST0001_UUID 00000020:01000000:1.0:1747399904.066976:0:29286:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399904.066978:0:29286:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1747399904.066980:0:29286:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to 6 as member 2 00000100:00100000:1.0:1747399904.067005:0:29286:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29286:1832281081702208:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399904.067073:0:29286:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e840 going to sleep for 6 seconds 00000100:00100000:1.0:1747399904.069948:0:29286:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29286:1832281081702208:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399904.069992:0:29286:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399904.069999:0:29286:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399904.070000:0:29286:0:(obd_config.c:1460:class_process_config()) marker 185 (0x2) lustre-clilov add lustre.6.lustre-OST0001_UUID 00000040:00080000:1.0:1747399904.070004:0:29286:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 285 count 279 00000020:01000000:2.0:1747399904.070180:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 279-284 (rc=0) 10000000:01000000:2.0:1747399904.070201:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399904.070208:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.070218:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399904.070236:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399904.070238:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399904.070241:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399904.070267:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.070272:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.070286:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399904.070304:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702272:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399904.070432:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.072185:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702272:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399904.072209:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.072218:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399904.072291:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702336:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399904.072357:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.074594:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081702336:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399904.074636:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399904.074643:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.074651:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.427517:0:29297:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399904.427540:0:29297:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.427551:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.427562:0:29297:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399904.427571:0:29297:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399904.427574:0:29297:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399904.427579:0:29297:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a99abbb0 00010000:00010000:1.0:1747399904.427581:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.427593:0:29297:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.427606:0:29297:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.427613:0:29297:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d7a.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=17 00000080:00200000:1.0:1747399904.427617:0:29297:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d7a.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=0 00000002:00010000:1.0:1747399904.427623:0:29297:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d7a.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.427655:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.427660:0:29297:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.427666:0:29297:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399904.427684:0:29297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702400:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399904.427754:0:29297:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e840 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.431095:0:29297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702400:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399904.431115:0:29297:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431140:0:29297:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431145:0:29297:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431151:0:29297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431157:0:29297:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431164:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431169:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431173:0:29297:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399904.431181:0:29297:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8801372e6d40 x1832281081702400/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399904.431190:0:29297:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431196:0:29297:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/10 (0 0) 00000080:00200000:2.0:1747399904.431213:0:29297:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xa:0x0], updating i_size 11776 00000080:00200000:2.0:1747399904.431231:0:29297:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xa:0x0](ffff880136f91fd8): rc = 0 00000080:00010000:2.0:1747399904.431237:0:29297:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xa:0x0](ffff880136f91fd8) for lock 0xd95e55596abdefa9 00000080:00010000:2.0:1747399904.431246:0:29297:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xa:0x0](ffff880136f91fd8) 00000080:00010000:2.0:1747399904.431248:0:29297:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdefa9 from it ffff8800a99abb20 00010000:00010000:2.0:1747399904.431250:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431255:0:29297:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b3c0/0xd95e55596abdefa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061d8 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399904.431281:0:29297:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399904.431293:0:29297:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399904.431295:0:29297:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800ae9bb200, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1747399904.431301:0:29297:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:2.0:1747399904.431359:0:29297:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x200000401:0xb:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1747399904.431393:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.431398:0:29297:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399904.431406:0:29297:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399904.431410:0:29297:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aada40 x1832281081702528/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399904.431415:0:29297:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399904.431428:0:29297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702528:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399904.431513:0:29297:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbe40 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.436572:0:29297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702528:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399904.436604:0:29297:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436621:0:29297:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 4/0,1 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436626:0:29297:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 4/0,1 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436634:0:29297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436642:0:29297:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436651:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436657:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436662:0:29297:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399904.436671:0:29297:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800b3aada40 x1832281081702528/t4294967328(4294967328) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:2.0:1747399904.436681:0:29297:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aada40 x1832281081702528/t4294967328(4294967328) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399904.436699:0:29297:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436708:0:29297:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/11 (0 0) 00000080:00200000:2.0:1747399904.436728:0:29297:0:(namei.c:1416:ll_create_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000080:00200000:2.0:1747399904.436751:0:29297:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8800af218898) 00000080:00200000:2.0:1747399904.436757:0:29297:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xb:0x0], updating i_size 0 00000080:00200000:2.0:1747399904.436803:0:29297:0:(file.c:5871:ll_layout_conf()) [0x200000401:0xb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1747399904.436808:0:29297:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0xb:0x0](ffff8800af218898) 00000080:00010000:2.0:1747399904.436810:0:29297:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb:0x0](ffff8800af218898) for lock 0xd95e55596abdefb0 00000080:00200000:2.0:1747399904.436825:0:29297:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8800af218898), flags 120501 00000002:00100000:2.0:1747399904.436839:0:29297:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aada40 x1832281081702528/t4294967328(4294967328) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:2.0:1747399904.436914:0:29297:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdefb0 from it ffff8800b662a1e0 00010000:00010000:2.0:1747399904.436917:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.436923:0:29297:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399904.436940:0:29297:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8800af218898), inode mode 81a4 mask 40 00000080:00200000:2.0:1747399904.436979:0:29297:0:(file.c:4008:ll_file_ioctl()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8800af218898), cmd=4008669a 00000002:00010000:2.0:1747399904.436991:0:29297:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0xb:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 040000002 00010000:00010000:2.0:1747399904.437024:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.437028:0:29297:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399904.437039:0:29297:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399904.437043:0:29297:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aad0c0 x1832281081702656/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399904.437047:0:29297:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399904.437063:0:29297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702656:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399904.437134:0:29297:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbe40 going to sleep for 43 seconds 00000100:00100000:0.0:1747399904.440019:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399904.440211:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399904.440238:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089230400 00000100:00100000:1.0:1747399904.440277:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 132 00000100:00100000:1.0:1747399904.440281:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:1600:x1832281089230400:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399904.440292:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.440358:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399904.440360:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:1600:x1832281089230400:12345-192.168.204.160@tcp:104: Request processed in 80us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399904.440371:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 132 00010000:00010000:3.0:1747399904.440416:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399904.440425:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.440435:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5b00 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399904.440439:0:4666:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.440446:0:4666:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.440453:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399904.440480:0:4666:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0xb:0x0]: losing layout lock 00010000:00010000:3.0:1747399904.440537:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.440543:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399904.440585:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.440591:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdefb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf6061f4 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.440607:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399904.440608:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399904.440609:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399904.440627:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399904.440645:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081702720:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399904.444449:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081702720:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399904.445244:0:29297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702656:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399904.445260:0:29297:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445273:0:29297:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445279:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445285:0:29297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445292:0:29297:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445298:0:29297:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5680 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399904.445301:0:29297:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445339:0:29297:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445345:0:29297:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445351:0:29297:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399904.445355:0:29297:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.445360:0:29297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399904.445376:0:29297:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8800b3aad0c0 x1832281081702656/t4294967329(4294967329) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1747399904.445386:0:29297:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aad0c0 x1832281081702656/t4294967329(4294967329) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399904.445468:0:29297:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1747399904.445474:0:29297:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399904.445482:0:29297:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1747399904.445484:0:29297:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399904.445525:0:29297:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xb:0x0], updating i_size 0 00000002:00100000:2.0:1747399904.445537:0:29297:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aad0c0 x1832281081702656/t4294967329(4294967329) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1747399904.445556:0:29297:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800b3aad0c0 x1832281081702656/t4294967329(4294967329) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:2.0:1747399904.445587:0:29297:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399904.445592:0:29297:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aacc00 x1832281081702848/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399904.445611:0:29297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702848:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747399904.445684:0:29297:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.448552:0:29297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702848:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399904.448587:0:29297:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800b3aad0c0 x1832281081702656/t4294967329(4294967329) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:2.0:1747399904.448620:0:29297:0:(file.c:6088:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000401:0xb:0x0](ffff8800af218898) 00000002:00010000:2.0:1747399904.448629:0:29297:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0xb:0x0]) in obj [0x200000401:0xb:0x0], intent: layout flags 0 00010000:00010000:2.0:1747399904.448675:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.448683:0:29297:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.448692:0:29297:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1747399904.448710:0:29297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702912:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399904.448780:0:29297:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.450558:0:29297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081702912:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399904.450581:0:29297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 4/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.450592:0:29297:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 4/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1747399904.450610:0:29297:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8800b3aac740 x1832281081702912/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 376/416 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399904.450618:0:29297:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1747399904.450627:0:29297:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.450637:0:29297:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/11 (0 0) 00000080:00010000:2.0:1747399904.450654:0:29297:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb:0x0](ffff8800af218898) for lock 0xd95e55596abdefbe 00000080:00010000:2.0:1747399904.450660:0:29297:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdefbe from it ffff8800a99abbf8 00010000:00010000:2.0:1747399904.450663:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.450669:0:29297:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.450686:0:29297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 2/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.450693:0:29297:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 2/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1747399904.450699:0:29297:0:(file.c:5976:ll_layout_lock_set()) ### file [0x200000401:0xb:0x0](ffff8800af218898) being reconfigured ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399904.450732:0:29297:0:(file.c:5871:ll_layout_conf()) [0x200000401:0xb:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:2.0:1747399904.450735:0:29297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.450745:0:29297:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399904.450798:0:29297:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8800af218898) 00000002:00100000:2.0:1747399904.450821:0:29297:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800b3aada40 x1832281081702528/t4294967328(4294967328) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:2.0:1747399904.450840:0:29297:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399904.450844:0:29297:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aac740 x1832281081703040/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399904.450859:0:29297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081703040:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747399904.450917:0:29297:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.453292:0:29297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29297:1832281081703040:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399904.453349:0:29297:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800b3aada40 x1832281081702528/t4294967328(4294967328) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000080:00200000:1.0:1747399904.460074:0:29298:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399904.460096:0:29298:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.460112:0:29298:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.460125:0:29298:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399904.460135:0:29298:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399904.460137:0:29298:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399904.460144:0:29298:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800aadf7bb0 00010000:00010000:1.0:1747399904.460146:0:29298:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.460153:0:29298:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.460168:0:29298:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.460175:0:29298:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:1.0:1747399904.460178:0:29298:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.460183:0:29298:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399904.460188:0:29298:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6fa0600, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399904.460194:0:29298:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:1.0:1747399904.460208:0:29298:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile2,[0x200000401:0xc:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399904.460270:0:29298:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.460285:0:29298:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399904.460296:0:29298:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399904.460306:0:29298:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e5f00 x1832281081703168/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399904.460332:0:29298:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399904.460353:0:29298:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703168:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399904.460517:0:29298:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59eb40 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.463881:0:29298:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703168:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399904.463907:0:29298:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.463926:0:29298:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 4/0,1 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.463931:0:29298:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 4/0,1 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.463941:0:29298:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.463958:0:29298:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.463968:0:29298:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.463973:0:29298:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.463978:0:29298:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399904.463985:0:29298:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8801372e5f00 x1832281081703168/t4294967332(4294967332) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:2.0:1747399904.463995:0:29298:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e5f00 x1832281081703168/t4294967332(4294967332) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399904.464005:0:29298:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.464013:0:29298:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/12 (0 0) 00000080:00200000:2.0:1747399904.464035:0:29298:0:(namei.c:1416:ll_create_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000080:00200000:2.0:1747399904.464057:0:29298:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8800af219058) 00000080:00200000:2.0:1747399904.464062:0:29298:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xc:0x0], updating i_size 0 00000080:00200000:2.0:1747399904.464097:0:29298:0:(file.c:5871:ll_layout_conf()) [0x200000401:0xc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1747399904.464102:0:29298:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0xc:0x0](ffff8800af219058) 00000080:00010000:2.0:1747399904.464105:0:29298:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xc:0x0](ffff8800af219058) for lock 0xd95e55596abdefc5 00000080:00200000:2.0:1747399904.464117:0:29298:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8800af219058), flags 120501 00000002:00100000:2.0:1747399904.464133:0:29298:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e5f00 x1832281081703168/t4294967332(4294967332) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:2.0:1747399904.464209:0:29298:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdefc5 from it ffff88012d57fe40 00010000:00010000:2.0:1747399904.464211:0:29298:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.464229:0:29298:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399904.464247:0:29298:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8800af219058), inode mode 81a4 mask 40 00000080:00200000:2.0:1747399904.464292:0:29298:0:(file.c:4008:ll_file_ioctl()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8800af219058), cmd=4008669a 00000002:00010000:2.0:1747399904.464308:0:29298:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0xc:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 040000002 00010000:00010000:2.0:1747399904.464385:0:29298:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.464391:0:29298:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399904.464401:0:29298:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399904.464405:0:29298:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aac280 x1832281081703296/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399904.464412:0:29298:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399904.464431:0:29298:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703296:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399904.464510:0:29298:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 43 seconds 00000100:00100000:0.0:1747399904.466613:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399904.466699:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089230464 00000100:00100000:1.0:1747399904.466747:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 133 00000100:00100000:1.0:1747399904.466752:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:14625:x1832281089230464:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399904.466766:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.466834:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399904.466839:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:14625:x1832281089230464:12345-192.168.204.160@tcp:104: Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399904.466846:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 133 00010000:00010000:2.0:1747399904.466990:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399904.466995:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.467013:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b180 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399904.467017:0:8848:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.467024:0:8848:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.467030:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399904.467055:0:8848:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0xc:0x0]: losing layout lock 00010000:00010000:2.0:1747399904.467097:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.467102:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399904.467136:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.467142:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abdefc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606233 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.467158:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399904.467159:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399904.467161:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399904.467176:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081703360:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399904.469434:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081703360:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1747399904.469434:0:29298:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703296:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399904.469451:0:29298:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469463:0:29298:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469475:0:29298:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469690:0:29298:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469701:0:29298:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469706:0:29298:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5680 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399904.469709:0:29298:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469715:0:29298:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469720:0:29298:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469726:0:29298:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399904.469730:0:29298:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.469735:0:29298:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5680/0xd95e55596abdefcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399904.469762:0:29298:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8800b3aac280 x1832281081703296/t4294967333(4294967333) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399904.469783:0:29298:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aac280 x1832281081703296/t4294967333(4294967333) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399904.469874:0:29298:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399904.469881:0:29298:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399904.469889:0:29298:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399904.469891:0:29298:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399904.469936:0:29298:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xc:0x0], updating i_size 0 00000002:00100000:1.0:1747399904.469948:0:29298:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aac280 x1832281081703296/t4294967333(4294967333) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399904.469966:0:29298:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800b3aac280 x1832281081703296/t4294967333(4294967333) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1747399904.469988:0:29298:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399904.469992:0:29298:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6d40 x1832281081703488/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399904.470008:0:29298:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703488:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399904.470074:0:29298:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.472947:0:29298:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703488:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399904.472973:0:29298:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800b3aac280 x1832281081703296/t4294967333(4294967333) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399948 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:2.0:1747399904.473004:0:29298:0:(file.c:6088:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000401:0xc:0x0](ffff8800af219058) 00000002:00010000:2.0:1747399904.473021:0:29298:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0xc:0x0]) in obj [0x200000401:0xc:0x0], intent: layout flags 0 00010000:00010000:2.0:1747399904.473061:0:29298:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.473069:0:29298:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.473078:0:29298:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1747399904.473096:0:29298:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703552:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399904.473757:0:29298:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb540 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.475564:0:29298:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703552:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399904.475589:0:29298:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.475600:0:29298:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1747399904.475612:0:29298:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8800b3aabdc0 x1832281081703552/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 376/416 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399904.475620:0:29298:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1747399904.475630:0:29298:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.475639:0:29298:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/12 (0 0) 00000080:00010000:2.0:1747399904.475657:0:29298:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xc:0x0](ffff8800af219058) for lock 0xd95e55596abdefd3 00000080:00010000:2.0:1747399904.475671:0:29298:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdefd3 from it ffff8800aadf7bf8 00010000:00010000:2.0:1747399904.475674:0:29298:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.475681:0:29298:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.475698:0:29298:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.475706:0:29298:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1747399904.475712:0:29298:0:(file.c:5976:ll_layout_lock_set()) ### file [0x200000401:0xc:0x0](ffff8800af219058) being reconfigured ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399904.475744:0:29298:0:(file.c:5871:ll_layout_conf()) [0x200000401:0xc:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:2.0:1747399904.475748:0:29298:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.475752:0:29298:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399904.475804:0:29298:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8800af219058) 00000002:00100000:2.0:1747399904.475828:0:29298:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e5f00 x1832281081703168/t4294967332(4294967332) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:2.0:1747399904.475850:0:29298:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399904.475855:0:29298:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aabdc0 x1832281081703680/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399904.475872:0:29298:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703680:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747399904.476358:0:29298:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399904.478011:0:29298:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29298:1832281081703680:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399904.478036:0:29298:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e5f00 x1832281081703168/t4294967332(4294967332) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000080:00200000:1.0:1747399904.483422:0:29299:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399904.483446:0:29299:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.483461:0:29299:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.483475:0:29299:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399904.483485:0:29299:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399904.483491:0:29299:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399904.483498:0:29299:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a99abb58 00010000:00010000:1.0:1747399904.483501:0:29299:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.483507:0:29299:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.483521:0:29299:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.483528:0:29299:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399904.483531:0:29299:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.483538:0:29299:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=1536 00000080:00200000:1.0:1747399904.483541:0:29299:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399904.483543:0:29299:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399904.483547:0:29299:0:(namei.c:1935:ll_mkdir()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00000020:00100000:1.0:1747399904.483602:0:29299:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399904.483613:0:29299:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e63c0 x1832281081703808/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399904.483635:0:29299:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29299:1832281081703808:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:1.0:1747399904.484013:0:29299:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.486581:0:29299:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29299:1832281081703808:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:2.0:1747399904.486622:0:29299:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818) 00000080:00200000:2.0:1747399904.486627:0:29299:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xd:0x0], updating i_size 512 00000080:00200000:1.0:1747399904.491505:0:29300:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399904.491528:0:29300:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.491545:0:29300:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.491559:0:29300:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399904.491577:0:29300:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399904.491580:0:29300:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399904.491586:0:29300:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136bebbb0 00010000:00010000:1.0:1747399904.491589:0:29300:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.491595:0:29300:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.491608:0:29300:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.491615:0:29300:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:1.0:1747399904.491618:0:29300:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.491624:0:29300:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399904.491627:0:29300:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6d2b500, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399904.491634:0:29300:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:1.0:1747399904.491647:0:29300:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x200000401:0xe:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399904.491698:0:29300:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.491704:0:29300:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399904.491715:0:29300:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399904.491724:0:29300:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6880 x1832281081703936/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399904.491731:0:29300:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399904.491757:0:29300:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081703936:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399904.491896:0:29300:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 43 seconds 00000100:00100000:1.0:1747399904.495533:0:29300:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081703936:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399904.495556:0:29300:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495568:0:29300:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495573:0:29300:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495578:0:29300:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495583:0:29300:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495588:0:29300:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45aac0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399904.495591:0:29300:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495597:0:29300:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495603:0:29300:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 5/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495621:0:29300:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399904.495626:0:29300:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495630:0:29300:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abdefda lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399904.495645:0:29300:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff8801372e6880 x1832281081703936/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399904.495778:0:29300:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399904.495792:0:29300:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.495802:0:29300:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495811:0:29300:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399904.495819:0:29300:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399904.495822:0:29300:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399904.495826:0:29300:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136bebbb0 00010000:00010000:1.0:1747399904.495827:0:29300:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495833:0:29300:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.495917:0:29300:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.495923:0:29300:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=19 00000080:00200000:1.0:1747399904.495930:0:29300:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.495939:0:29300:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6d2a300, open_flags 1a100, mode 0 opened 0 00000080:00200000:1.0:1747399904.495943:0:29300:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open 00000002:00010000:1.0:1747399904.495951:0:29300:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 0320401 00010000:00010000:1.0:1747399904.495989:0:29300:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.495995:0:29300:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399904.496004:0:29300:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399904.496010:0:29300:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6880 x1832281081704064/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399904.496016:0:29300:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399904.496035:0:29300:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081704064:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399904.496342:0:29300:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 43 seconds 00000100:00100000:1.0:1747399904.498750:0:29300:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081704064:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399904.498770:0:29300:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498783:0:29300:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498788:0:29300:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498809:0:29300:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498815:0:29300:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498819:0:29300:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a640 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399904.498823:0:29300:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498828:0:29300:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498834:0:29300:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498839:0:29300:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399904.498843:0:29300:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.498847:0:29300:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abdefe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29300 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399904.498864:0:29300:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8801372e6880 x1832281081704064/t4294967337(4294967337) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399904.498874:0:29300:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6880 x1832281081704064/t4294967337(4294967337) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399904.498911:0:29300:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xd:0x0], updating i_size 512 00000080:00200000:1.0:1747399904.498917:0:29300:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xd:0x0](ffff8800af219818): rc = 0 00000080:00010000:1.0:1747399904.498922:0:29300:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xd:0x0](ffff8800af219818) for lock 0x0 00000080:00200000:1.0:1747399904.498943:0:29300:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818), flags 320400 00000002:00100000:1.0:1747399904.498960:0:29300:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e6880 x1832281081704064/t4294967337(4294967337) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399904.499037:0:29300:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818), inode mode 41ed mask 44 00000080:00200000:1.0:1747399904.499083:0:29300:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818), cmd=0x4008669a 00000020:00100000:1.0:1747399904.499440:0:29300:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399904.499446:0:29300:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e7200 x1832281081704192/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399904.499466:0:29300:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081704192:192.168.204.160@tcp:36:lfs.0 00000100:00100000:1.0:1747399904.499529:0:29300:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 43 seconds 00000100:00100000:1.0:1747399904.501828:0:29300:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081704192:192.168.204.160@tcp:36:lfs.0 00000080:00200000:1.0:1747399904.501887:0:29300:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818) 00000002:00100000:1.0:1747399904.501923:0:29300:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e6880 x1832281081704064/t4294967337(4294967337) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747399904.501951:0:29300:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399904.501955:0:29300:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e76c0 x1832281081704320/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399904.501969:0:29300:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081704320:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399904.502015:0:29300:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:1.0:1747399904.504284:0:29300:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29300:1832281081704320:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399904.504337:0:29300:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e6880 x1832281081704064/t4294967337(4294967337) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1747399904.510676:0:29301:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399904.510697:0:29301:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399904.510711:0:29301:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.510723:0:29301:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399904.510732:0:29301:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399904.510734:0:29301:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399904.510745:0:29301:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012f5bfbb0 00010000:00010000:3.0:1747399904.510748:0:29301:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.510756:0:29301:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399904.510773:0:29301:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399904.510780:0:29301:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:3.0:1747399904.510783:0:29301:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399904.510789:0:29301:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399904.510793:0:29301:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8801373d1b00, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1747399904.510801:0:29301:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:3.0:1747399904.510815:0:29301:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x200000401:0xf:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1747399904.510867:0:29301:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.510873:0:29301:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399904.510883:0:29301:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399904.510892:0:29301:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf63dc0 x1832281081704448/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399904.510899:0:29301:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399904.510919:0:29301:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704448:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399904.511072:0:29301:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399904.514485:0:29301:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704448:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399904.514507:0:29301:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514519:0:29301:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514524:0:29301:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514529:0:29301:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514535:0:29301:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514540:0:29301:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b22f40 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399904.514543:0:29301:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514548:0:29301:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514553:0:29301:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 5/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514558:0:29301:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399904.514562:0:29301:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514580:0:29301:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22f40/0xd95e55596abdefe8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399904.514597:0:29301:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff88012bf63dc0 x1832281081704448/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399904.514798:0:29301:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399904.514813:0:29301:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399904.514826:0:29301:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514834:0:29301:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399904.514842:0:29301:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399904.514844:0:29301:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399904.514849:0:29301:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012f5bfbb0 00010000:00010000:3.0:1747399904.514850:0:29301:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514856:0:29301:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399904.514869:0:29301:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399904.514875:0:29301:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=19 00000080:00200000:3.0:1747399904.514878:0:29301:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399904.514888:0:29301:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8801373d1c80, open_flags 1a100, mode 0 opened 0 00000080:00200000:3.0:1747399904.514893:0:29301:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open 00000002:00010000:3.0:1747399904.514906:0:29301:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 0320401 00010000:00010000:3.0:1747399904.514943:0:29301:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.514948:0:29301:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399904.514958:0:29301:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399904.514963:0:29301:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf63dc0 x1832281081704576/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399904.514969:0:29301:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399904.514985:0:29301:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704576:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399904.515064:0:29301:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399904.517745:0:29301:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704576:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399904.517764:0:29301:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517776:0:29301:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517782:0:29301:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517787:0:29301:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517792:0:29301:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517805:0:29301:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b22d00 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399904.517809:0:29301:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517813:0:29301:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517818:0:29301:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517823:0:29301:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399904.517825:0:29301:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.517829:0:29301:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22d00/0xd95e55596abdefef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29301 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399904.517840:0:29301:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf63dc0 x1832281081704576/t4294967340(4294967340) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399904.517850:0:29301:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf63dc0 x1832281081704576/t4294967340(4294967340) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399904.517876:0:29301:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xd:0x0], updating i_size 512 00000080:00200000:3.0:1747399904.517879:0:29301:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xd:0x0](ffff8800af219818): rc = 0 00000080:00010000:3.0:1747399904.517883:0:29301:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xd:0x0](ffff8800af219818) for lock 0x0 00000080:00200000:3.0:1747399904.517902:0:29301:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818), flags 320400 00000002:00100000:3.0:1747399904.517916:0:29301:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf63dc0 x1832281081704576/t4294967340(4294967340) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399904.517994:0:29301:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818), inode mode 41ed mask 44 00000080:00200000:3.0:1747399904.518038:0:29301:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818), cmd=0x4008669a 00000020:00100000:3.0:1747399904.518082:0:29301:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399904.518087:0:29301:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62f80 x1832281081704704/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399904.518104:0:29301:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62f80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704704:192.168.204.160@tcp:36:lfs.0 00000100:00100000:3.0:1747399904.518164:0:29301:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399904.520335:0:29301:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62f80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704704:192.168.204.160@tcp:36:lfs.0 00000080:00200000:3.0:1747399904.520390:0:29301:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818) 00000002:00100000:3.0:1747399904.520421:0:29301:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf63dc0 x1832281081704576/t4294967340(4294967340) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:3.0:1747399904.520441:0:29301:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399904.520445:0:29301:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf63440 x1832281081704832/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399904.520460:0:29301:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63440 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704832:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399904.520666:0:29301:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399904.522883:0:29301:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63440 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29301:1832281081704832:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747399904.522912:0:29301:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf63dc0 x1832281081704576/t4294967340(4294967340) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1747399904.528947:0:29302:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399904.528971:0:29302:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399904.528987:0:29302:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.529007:0:29302:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399904.529018:0:29302:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399904.529020:0:29302:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399904.529027:0:29302:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136bebaf8 00010000:00010000:3.0:1747399904.529030:0:29302:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.529036:0:29302:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399904.529049:0:29302:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399904.529057:0:29302:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:3.0:1747399904.529060:0:29302:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399904.529066:0:29302:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:3.0:1747399904.529070:0:29302:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:3.0:1747399904.529077:0:29302:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399904.529118:0:29302:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.529123:0:29302:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.529131:0:29302:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399904.529158:0:29302:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63440 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29302:1832281081704896:192.168.204.160@tcp:101:rm.0 00000100:00100000:3.0:1747399904.529399:0:29302:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399904.534122:0:29302:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63440 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29302:1832281081704896:192.168.204.160@tcp:101:rm.0 00010000:00010000:3.0:1747399904.534148:0:29302:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.534162:0:29302:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.534168:0:29302:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.534178:0:29302:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.534186:0:29302:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.534196:0:29302:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.534203:0:29302:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399904.534208:0:29302:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399904.534230:0:29302:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012bf63440 x1832281081704896/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/712 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:3.0:1747399904.534238:0:29302:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1747399904.534261:0:29302:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399904.534270:0:29302:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/11 (0 0) 00000080:00200000:3.0:1747399904.534350:0:29302:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xb:0x0](ffff8800af218898): rc = 0 00000080:00200000:3.0:1747399904.534363:0:29302:0:(file.c:5871:ll_layout_conf()) [0x200000401:0xb:0x0]: layout version change: 0 -> 0 00000080:00010000:3.0:1747399904.534368:0:29302:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb:0x0](ffff8800af218898) for lock 0xd95e55596abdeff6 00000080:00010000:3.0:1747399904.534380:0:29302:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xb:0x0](ffff8800af218898) 00000080:00010000:3.0:1747399904.534382:0:29302:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdeff6 from it ffff880136bebbb8 00010000:00010000:3.0:1747399904.534384:0:29302:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399904.534390:0:29302:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1747399904.534427:0:29302:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8800af218898),name=testfile1 00000002:00010000:3.0:1747399904.534441:0:29302:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0xb:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399904.534448:0:29302:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399904.534456:0:29302:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00000080:00010000:3.0:1747399904.534462:0:29302:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xb:0x0](ffff8800af218898) 00000080:00010000:3.0:1747399904.534465:0:29302:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb:0x0](ffff8800af218898) for lock 0xd95e55596abdeff6 00000080:00010000:3.0:1747399904.534467:0:29302:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdeff6 from it ffff880136bebcf8 00010000:00010000:3.0:1747399904.534469:0:29302:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399904.534478:0:29302:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1747399904.534493:0:29302:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xb:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1747399904.534502:0:29302:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000401:0xb:0x0] 00000008:00010000:3.0:1747399904.534526:0:29302:0:(lustre_osc.h:181:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1747399904.534528:0:29302:0:(osc_lock.c:1241:osc_lock_init()) ### lock ffff8800b5998730, osc lock ffff88012bf4e000, flags 0x400001002 00010000:00010000:3.0:1747399904.534554:0:29302:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 3/1,0 mode: --/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.534560:0:29302:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 3/1,0 mode: --/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1747399904.534573:0:29302:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-ffff8800b65c8800: connect to NID 192.168.204.160@tcp last attempt 134 00000100:00080000:3.0:1747399904.534578:0:29302:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-ffff8800b65c8800: import ffff88012dfe6000 using connection 192.168.204.160@tcp/192.168.204.160@tcp 00000008:00100000:3.0:1747399904.534587:0:29302:0:(osc_request.c:3485:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 34539008 ocd_grant: 3407872, lost: 0. 00000100:00100000:3.0:1747399904.534606:0:29302:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88012bf63dc0 x1832281081704960/t0(0) o8->lustre-OST0001-osc-ffff8800b65c8800@192.168.204.160@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399904.534686:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1747399904.534703:0:1864:0:(client.c:1659:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff88012bf63440 x1832281081705024/t0(0) o101->lustre-OST0001-osc-ffff8800b65c8800@192.168.204.160@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/0/ffffffff rc 0/-1 job:'rm.0' 00000100:00100000:1.0:1747399904.534781:0:1861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1861:1832281081704960:192.168.204.160@tcp:8:rm.0 00010000:00080000:2.0:1747399904.539145:0:1861:0:(ldlm_request.c:1490:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=62166) req@ffff88012bf63dc0 x1832281081704960/t0(0) o8->lustre-OST0001-osc-ffff8800b65c8800@192.168.204.160@tcp:28/4 lens 520/416 e 0 to 0 dl 1747399910 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'rm.0' 00000100:00100000:2.0:1747399904.539159:0:1861:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8800b65c8800: committing for last_committed 0 gen 2 00000100:00080000:2.0:1747399904.539167:0:1861:0:(import.c:1074:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8800b65c8800: connect to target with instance 1 00000100:00080000:2.0:1747399904.539176:0:1861:0:(import.c:934:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8800b65c8800: Resetting ns_connect_flags to server flags: 0xa0425af2e3440078 00000080:00000004:2.0:1747399904.539187:0:1861:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1747399904.539194:0:1861:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1747399904.539198:0:1861:0:(import.c:1159:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1747399904.539200:0:1861:0:(import.c:86:import_set_state_nolock()) ffff88012dfe6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000080:00000004:2.0:1747399904.539207:0:1861:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1747399904.539209:0:1861:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1747399904.539214:0:1861:0:(recover.c:218:ptlrpc_wake_delayed()) @@@ waking (set ffff8800b3a56180): req@ffff88012bf63440 x1832281081705024/t0(0) o101->lustre-OST0001-osc-ffff8800b65c8800@192.168.204.160@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/0/ffffffff rc 0/-1 job:'rm.0' 00000100:00100000:2.0:1747399904.539246:0:1861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1861:1832281081704960:192.168.204.160@tcp:8:rm.0 00010000:00010000:3.0:1747399904.542839:0:1864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 6/2,0 mode: --/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.542868:0:1864:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 6/2,0 mode: --/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.544501:0:1864:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 6/2,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.544530:0:1864:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 6/2,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1747399904.544546:0:1864:0:(osc_lock.c:196:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 5/2,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.544585:0:1864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 6/2,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.544591:0:1864:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 5/1,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.544597:0:1864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 5/1,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399904.544603:0:1864:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 4/0,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1747399904.544623:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:0:1832281081705024:192.168.204.160@tcp:101:rm.0 00000080:00200000:0.0:1747399904.544763:0:29302:0:(file.c:1496:ll_merge_attr()) [0x200000401:0xb:0x0] updating i_size 0 00000020:00010000:0.0:1747399904.544769:0:29302:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff88012d578470 (ffff88012b46a128/0) at cl_lock_release():234 00000020:00010000:0.0:1747399904.544772:0:29302:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff88012d578470 (ffff88012b46a128/0) at cl_lock_cancel():151 00000020:00010000:0.0:1747399904.544776:0:29302:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b5998730 (ffff88012b46a488/1) at cl_lock_cancel():151 00000020:00010000:0.0:1747399904.544780:0:29302:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff88012d578470 (ffff88012b46a128/0) at cl_lock_fini():84 00000020:00010000:0.0:1747399904.544781:0:29302:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b5998730 (ffff88012b46a128/1) at cl_lock_fini():84 00000080:00200000:0.0:1747399904.544794:0:29302:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xb:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0 00000080:00200000:0.0:1747399904.544895:0:29302:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:0.0:1747399904.544913:0:29302:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399904.544926:0:29302:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399904.544956:0:29302:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1747399904.544967:0:29302:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:0.0:1747399904.544972:0:29302:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:0.0:1747399904.544979:0:29302:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136bebb90 00010000:00010000:0.0:1747399904.544981:0:29302:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399904.544987:0:29302:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1747399904.544996:0:29302:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399904.545004:0:29302:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:0.0:1747399904.545007:0:29302:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399904.545012:0:29302:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=testfile1, flags=0 00000080:00200000:0.0:1747399904.545014:0:29302:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:0.0:1747399904.545018:0:29302:0:(namei.c:2063:ll_unlink()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:0.0:1747399904.545045:0:29302:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399904.545061:0:29302:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0xb:0x0]: losing layout lock 00010000:00010000:0.0:1747399904.545070:0:29302:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399904.545076:0:29302:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0xb:0x0]: losing layout lock 00010000:00010000:0.0:1747399904.545100:0:29302:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399904.545111:0:29302:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 1/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399904.545115:0:29302:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1747399904.545116:0:29302:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b22400/0xd95e55596abdeff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf6062f0 expref: -99 pid: 29302 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399904.545141:0:29302:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdefbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606217 expref: -99 pid: 29297 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1747399904.545157:0:29302:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1747399904.545162:0:29302:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880137119300 x1832281081705152/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1747399904.545187:0:29302:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29302:1832281081705152:192.168.204.160@tcp:36:rm.0 00000100:00100000:0.0:1747399904.545268:0:29302:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753780 going to sleep for 43 seconds 00000100:00100000:0.0:1747399904.550457:0:29302:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29302:1832281081705152:192.168.204.160@tcp:36:rm.0 00000080:00200000:0.0:1747399904.550612:0:29302:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1747399904.550626:0:29302:0:(lov_io.c:825:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1747399904.550652:0:29302:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:0.0:1747399904.550657:0:29302:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8800af218898) 00000008:00010000:0.0:1747399904.550979:0:29302:0:(osc_object.c:224:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 0 blocks 1 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 1/0,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1747399904.556298:0:29303:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399904.556338:0:29303:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.556350:0:29303:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.556360:0:29303:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399904.556368:0:29303:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399904.556370:0:29303:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399904.556375:0:29303:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012f5bfaf8 00010000:00010000:1.0:1747399904.556377:0:29303:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.556382:0:29303:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.556397:0:29303:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.556403:0:29303:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399904.556405:0:29303:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.556409:0:29303:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:1.0:1747399904.556412:0:29303:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:1.0:1747399904.556417:0:29303:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile2,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1747399904.556447:0:29303:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.556452:0:29303:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.556466:0:29303:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399904.556485:0:29303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29303:1832281081705216:192.168.204.160@tcp:101:rm.0 00000100:00100000:1.0:1747399904.557861:0:29303:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.560955:0:29303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29303:1832281081705216:192.168.204.160@tcp:101:rm.0 00010000:00010000:2.0:1747399904.560972:0:29303:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.560995:0:29303:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.561000:0:29303:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.561007:0:29303:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.561014:0:29303:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.561021:0:29303:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.561027:0:29303:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.561031:0:29303:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399904.561039:0:29303:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8801372e76c0 x1832281081705216/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/712 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:2.0:1747399904.561046:0:29303:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1747399904.561055:0:29303:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.561069:0:29303:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/12 (0 0) 00000080:00200000:2.0:1747399904.561104:0:29303:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xc:0x0](ffff8800af219058): rc = 0 00000080:00200000:2.0:1747399904.561112:0:29303:0:(file.c:5871:ll_layout_conf()) [0x200000401:0xc:0x0]: layout version change: 0 -> 0 00000080:00010000:2.0:1747399904.561116:0:29303:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xc:0x0](ffff8800af219058) for lock 0xd95e55596abdf004 00000080:00010000:2.0:1747399904.561124:0:29303:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xc:0x0](ffff8800af219058) 00000080:00010000:2.0:1747399904.561126:0:29303:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf004 from it ffff88012f5bfbb8 00010000:00010000:2.0:1747399904.561128:0:29303:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.561133:0:29303:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399904.561160:0:29303:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8800af219058),name=testfile2 00000002:00010000:2.0:1747399904.561169:0:29303:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0xc:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1747399904.561174:0:29303:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.561181:0:29303:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1747399904.561187:0:29303:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xc:0x0](ffff8800af219058) 00000080:00010000:2.0:1747399904.561189:0:29303:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xc:0x0](ffff8800af219058) for lock 0xd95e55596abdf004 00000080:00010000:2.0:1747399904.561192:0:29303:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf004 from it ffff88012f5bfcf8 00010000:00010000:2.0:1747399904.561193:0:29303:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399904.561285:0:29303:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399904.561303:0:29303:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1747399904.561326:0:29303:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000401:0xc:0x0] 00000008:00010000:2.0:1747399904.561344:0:29303:0:(lustre_osc.h:181:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1747399904.561346:0:29303:0:(osc_lock.c:1241:osc_lock_init()) ### lock ffff8800b3a1f930, osc lock ffff88012e262000, flags 0x400001002 00010000:00010000:2.0:1747399904.561363:0:29303:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 3/1,0 mode: --/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.561369:0:29303:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 3/1,0 mode: --/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1747399904.561505:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399904.561518:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081705280:192.168.204.160@tcp:101:rm.0 00010000:00010000:2.0:1747399904.564704:0:1865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 6/2,0 mode: --/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.564730:0:1865:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 6/2,0 mode: --/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.564742:0:1865:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 6/2,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.564753:0:1865:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 6/2,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1747399904.564766:0:1865:0:(osc_lock.c:196:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 5/2,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.564808:0:1865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 6/2,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.564814:0:1865:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 5/1,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.564819:0:1865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 5/1,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399904.564823:0:1865:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 4/0,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1747399904.564840:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081705280:192.168.204.160@tcp:101:rm.0 00000080:00200000:0.0:1747399904.564849:0:29303:0:(file.c:1496:ll_merge_attr()) [0x200000401:0xc:0x0] updating i_size 0 00000020:00010000:0.0:1747399904.564853:0:29303:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff88012e9f0b18 (ffff8801368b6368/0) at cl_lock_release():234 00000020:00010000:0.0:1747399904.564856:0:29303:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff88012e9f0b18 (ffff8801368b6368/0) at cl_lock_cancel():151 00000020:00010000:0.0:1747399904.564865:0:29303:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b3a1f930 (ffff8801368b6488/1) at cl_lock_cancel():151 00000020:00010000:0.0:1747399904.564869:0:29303:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff88012e9f0b18 (ffff8801368b6368/0) at cl_lock_fini():84 00000020:00010000:0.0:1747399904.564871:0:29303:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b3a1f930 (ffff8801368b6368/1) at cl_lock_fini():84 00000080:00200000:0.0:1747399904.564886:0:29303:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xc:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0 00000080:00200000:0.0:1747399904.564978:0:29303:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:0.0:1747399904.564995:0:29303:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399904.565006:0:29303:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399904.565016:0:29303:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1747399904.565025:0:29303:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:0.0:1747399904.565027:0:29303:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:0.0:1747399904.565032:0:29303:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012f5bfb90 00010000:00010000:0.0:1747399904.565034:0:29303:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399904.565039:0:29303:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1747399904.565047:0:29303:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399904.565053:0:29303:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:0.0:1747399904.565056:0:29303:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399904.565061:0:29303:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=testfile2, flags=0 00000080:00200000:0.0:1747399904.565064:0:29303:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:0.0:1747399904.565068:0:29303:0:(namei.c:2063:ll_unlink()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:0.0:1747399904.565092:0:29303:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399904.565117:0:29303:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0xc:0x0]: losing layout lock 00010000:00010000:0.0:1747399904.565128:0:29303:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399904.565134:0:29303:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0xc:0x0]: losing layout lock 00010000:00010000:0.0:1747399904.565160:0:29303:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399904.565165:0:29303:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399904.565169:0:29303:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1747399904.565170:0:29303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a400/0xd95e55596abdf004 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606336 expref: -99 pid: 29303 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399904.565180:0:29303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdefd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606256 expref: -99 pid: 29298 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1747399904.565196:0:29303:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1747399904.565202:0:29303:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88013711df00 x1832281081705408/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1747399904.566153:0:29303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29303:1832281081705408:192.168.204.160@tcp:36:rm.0 00000100:00100000:0.0:1747399904.566251:0:29303:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753c00 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.571762:0:29303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29303:1832281081705408:192.168.204.160@tcp:36:rm.0 00000080:00200000:2.0:1747399904.571802:0:29303:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0xc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1747399904.571811:0:29303:0:(lov_io.c:825:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1747399904.571847:0:29303:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0xc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399904.571851:0:29303:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8800af219058) 00000008:00010000:2.0:1747399904.571875:0:29303:0:(osc_object.c:224:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 0 blocks 1 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 1/0,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1747399904.582446:0:29304:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399904.582466:0:29304:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399904.582478:0:29304:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.582489:0:29304:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399904.582497:0:29304:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399904.582500:0:29304:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399904.582504:0:29304:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136bebb98 00010000:00010000:1.0:1747399904.582506:0:29304:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.582511:0:29304:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399904.582522:0:29304:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.582528:0:29304:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399904.582530:0:29304:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399904.582537:0:29304:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:1.0:1747399904.582541:0:29304:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:1.0:1747399904.582552:0:29304:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1747399904.582584:0:29304:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.582589:0:29304:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399904.582596:0:29304:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399904.582615:0:29304:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29304:1832281081705472:192.168.204.160@tcp:101:rmdir.0 00000100:00100000:1.0:1747399904.582673:0:29304:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e480 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.586037:0:29304:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29304:1832281081705472:192.168.204.160@tcp:101:rmdir.0 00010000:00010000:2.0:1747399904.586056:0:29304:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586077:0:29304:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586082:0:29304:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586089:0:29304:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586095:0:29304:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586102:0:29304:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586106:0:29304:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586109:0:29304:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399904.586116:0:29304:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8801372e6880 x1832281081705472/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747399948 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rmdir.0' 00000002:00010000:2.0:1747399904.586124:0:29304:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586131:0:29304:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/13 (0 0) 00000080:00200000:2.0:1747399904.586152:0:29304:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0xd:0x0], updating i_size 512 00000080:00200000:2.0:1747399904.586158:0:29304:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xd:0x0](ffff8800af219818): rc = 0 00000080:00010000:2.0:1747399904.586163:0:29304:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0xd:0x0](ffff8800af219818) for lock 0xd95e55596abdf012 00000080:00010000:2.0:1747399904.586171:0:29304:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xd:0x0](ffff8800af219818) 00000080:00010000:2.0:1747399904.586173:0:29304:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf012 from it ffff880136bebd90 00010000:00010000:2.0:1747399904.586175:0:29304:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586180:0:29304:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399904.586204:0:29304:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399904.586211:0:29304:0:(namei.c:1967:ll_rmdir()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:2.0:1747399904.586236:0:29304:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586271:0:29304:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399904.586275:0:29304:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399904.586277:0:29304:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf606375 expref: -99 pid: 29304 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399904.586292:0:29304:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399904.586296:0:29304:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aab440 x1832281081705600/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399904.586330:0:29304:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29304:1832281081705600:192.168.204.160@tcp:36:rmdir.0 00000100:00100000:2.0:1747399904.586374:0:29304:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 43 seconds 00000100:00100000:2.0:1747399904.590446:0:29304:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29304:1832281081705600:192.168.204.160@tcp:36:rmdir.0 00000080:00200000:2.0:1747399904.590479:0:29304:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0xd:0x0](ffff8800af219818) 00010000:00010000:2.0:1747399904.903820:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399905.265242:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399905.265500:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399905.265501:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089230528 00000100:00100000:0.0:1747399905.265534:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089230592 00000100:00100000:1.0:1747399905.265545:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 134 00000100:00100000:1.0:1747399905.265551:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:3621:x1832281089230528:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399905.265566:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399905.265649:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399905.265654:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:3621:x1832281089230528:12345-192.168.204.160@tcp:104: Request processed in 103us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399905.265661:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 134 00000100:00100000:1.0:1747399905.265676:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 135 00000100:00100000:1.0:1747399905.265679:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:3621:x1832281089230592:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399905.265686:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399905.265718:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1747399905.265726:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1747399905.265734:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:3621:x1832281089230592:12345-192.168.204.160@tcp:104: Request processed in 55us (235us total) trans 0 rc 0/0 00010000:00010000:3.0:1747399905.265738:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399905.265739:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 135 00010000:00010000:2.0:1747399905.265767:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399905.265769:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f58c0 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:2.0:1747399905.265771:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399905.265772:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399905.265779:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399905.265779:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f33c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399905.265780:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399905.265783:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399905.265785:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399905.265787:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1747399905.265789:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399905.265793:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399905.265843:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399905.265849:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399905.265869:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399905.265874:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdef9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6061b5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399905.265945:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399905.265946:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399905.265948:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399905.265969:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081705664:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399905.266032:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399905.266039:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1747399905.266198:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081705728:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399905.266199:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399905.266219:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdefa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6061bc expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399905.266235:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399905.266236:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399905.266237:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399905.267612:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081705664:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399905.268119:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081705728:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399905.905647:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399906.548274:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399906.548398:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089231616 00000100:00100000:1.0:1747399906.548438:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 136 00000100:00100000:1.0:1747399906.548443:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:10067:x1832281089231616:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399906.548455:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 2/0,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399906.548515:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399906.548519:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:10067:x1832281089231616:12345-192.168.204.160@tcp:104: Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399906.548525:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 136 00010000:00010000:2.0:1747399906.548650:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399906.548654:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 2/0,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399906.548661:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b22640 already unused, calling callback (ffffffffa04b1280) 00010000:00010000:2.0:1747399906.548664:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 3/0,0 mode: PR/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399906.548697:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 2/0,0 mode: --/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399906.548702:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399906.549516:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 1/0,0 mode: --/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399906.549525:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff880136b22640/0xd95e55596abdeffd lrc: 0/0,0 mode: --/PR res: [0x3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf6062fe expref: -99 pid: 29302 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399906.549556:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399906.549557:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399906.549558:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399906.549565:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399906.549577:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081705792:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399906.551677:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081705792:192.168.204.160@tcp:103:ldlm_bl_03.0 10000000:01000000:0.0:1747399906.658422:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399906.658440:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 285 10000000:01000000:0.0:1747399906.658444:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399906.658479:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399906.658488:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399906.658497:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399906.658517:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081705856:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399906.658600:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753a80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399906.660491:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081705856:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399906.660705:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399906.660715:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399906.660777:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081705920:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399906.660829:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399906.662389:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081705920:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399906.662421:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081705984:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399906.662471:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399906.664437:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081705984:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399906.664903:0:29326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29326:1832281081706048:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399906.664956:0:29326:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399906.667117:0:29326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29326:1832281081706048:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399906.667144:0:29326:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399906.667154:0:29326:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399906.667156:0:29326:0:(obd_config.c:1460:class_process_config()) marker 187 (0x1) lustre-clilov rem lustre.6.lustre-OST0000_UUID 00000020:01000000:3.0:1747399906.667160:0:29326:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399906.667162:0:29326:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399906.667170:0:29326:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from 6 00000100:00100000:3.0:1747399906.667198:0:29326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29326:1832281081706112:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399906.667240:0:29326:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399906.670280:0:29326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29326:1832281081706112:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399906.670338:0:29326:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399906.670343:0:29326:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399906.670344:0:29326:0:(obd_config.c:1460:class_process_config()) marker 187 (0x2) lustre-clilov rem lustre.6.lustre-OST0000_UUID 00000040:00080000:3.0:1747399906.670347:0:29326:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 288 count 282 00000020:01000000:2.0:1747399906.670567:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 285-287 (rc=0) 10000000:01000000:2.0:1747399906.670589:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399906.670595:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399906.670604:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399906.670611:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399906.670613:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399906.670615:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399906.670635:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399906.670649:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399906.670655:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399906.670668:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706176:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399906.670719:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399906.672477:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706176:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399906.672493:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399906.672503:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399906.672556:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706240:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399906.672600:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399906.674663:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706240:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399906.674699:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399906.674705:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399906.674713:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399906.910118:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399907.638701:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399907.638758:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399907.638796:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089234240 00000100:00100000:0.0:1747399907.638828:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089234368 00000100:00100000:0.0:1747399907.638837:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 137 00000100:00100000:0.0:1747399907.638841:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:3732:x1832281089234240:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399907.638855:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399907.638928:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399907.638933:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:3732:x1832281089234240:12345-192.168.204.160@tcp:104: Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399907.638939:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 137 00000100:00100000:0.0:1747399907.638953:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 138 00000100:00100000:0.0:1747399907.638956:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:3732:x1832281089234368:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399907.638961:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399907.639795:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399907.639801:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399907.640225:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399907.640229:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399907.640236:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3600 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399907.640239:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399907.640246:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399907.640251:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399907.640254:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399907.640292:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399907.640298:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399907.640332:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f58c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399907.640333:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399907.640338:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399907.640342:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399907.640346:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399907.640359:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399907.640363:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399907.640384:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399907.640389:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f58c0/0xd95e55596abdf020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6063a6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399907.640403:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399907.640404:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399907.640405:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399907.640422:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081706368:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399907.640448:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399907.640453:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60639f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399907.640478:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1747399907.640481:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399907.640482:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399907.640483:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081706304:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399907.640483:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747399907.640632:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1747399907.640638:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:3732:x1832281089234368:12345-192.168.204.160@tcp:104: Request processed in 1680us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399907.640645:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 138 00000100:00100000:3.0:1747399907.642894:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081706304:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399907.642906:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081706368:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399907.911620:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399908.635905:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399908.635911:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399908.635957:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081706496:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399908.636074:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1747399908.636079:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081706432:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399908.636096:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081706560:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399908.638820:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081706432:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399908.638840:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081706560:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399908.638848:0:1865:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967345 gen 1 00000100:00100000:2.0:1747399908.639038:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081706496:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399908.913639:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399909.001406:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399909.001411:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 288 10000000:01000000:2.0:1747399909.001416:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399909.001450:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.001459:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.001467:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399909.001487:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706624:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399909.001556:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399909.003934:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706624:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399909.003962:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.003973:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399909.004050:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706688:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399909.004121:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399909.005786:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706688:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399909.005835:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706752:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399909.005908:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399909.007679:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706752:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399909.009279:0:29354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29354:1832281081706816:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399909.009491:0:29354:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399909.012589:0:29354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29354:1832281081706816:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399909.012632:0:29354:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399909.012641:0:29354:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399909.012643:0:29354:0:(obd_config.c:1460:class_process_config()) marker 189 (0x1) lustre-clilov rem lustre.6.lustre-OST0001_UUID 00000020:01000000:3.0:1747399909.012648:0:29354:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399909.012651:0:29354:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399909.012663:0:29354:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from 6 00000100:00100000:3.0:1747399909.012697:0:29354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29354:1832281081706880:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399909.012766:0:29354:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b180 going to sleep for 6 seconds 00000100:00100000:3.0:1747399909.020075:0:29354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29354:1832281081706880:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399909.020120:0:29354:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399909.020127:0:29354:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399909.020129:0:29354:0:(obd_config.c:1460:class_process_config()) marker 189 (0x2) lustre-clilov rem lustre.6.lustre-OST0001_UUID 00000040:00080000:3.0:1747399909.020144:0:29354:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 291 count 285 00000020:01000000:2.0:1747399909.020334:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 288-290 (rc=0) 10000000:01000000:2.0:1747399909.020356:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399909.020363:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.020378:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399909.020386:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399909.020389:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399909.020391:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399909.020422:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.020427:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.020435:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399909.020453:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706944:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399909.020519:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399909.022008:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081706944:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399909.022027:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.022037:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399909.022092:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707008:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399909.022125:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399909.024839:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707008:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399909.024892:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399909.024899:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.024909:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399909.345072:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399909.345172:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:2.0:1747399909.345272:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089236736 00000100:00100000:2.0:1747399909.345387:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 11 00000100:00100000:2.0:1747399909.345394:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:3873:x1832281089236736:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399909.345412:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399909.345486:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1747399909.345490:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:3873:x1832281089236736:12345-192.168.204.160@tcp:104: Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1747399909.345496:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 11 00010000:00010000:3.0:1747399909.345511:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399909.345516:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.345527:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6d00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399909.345530:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.345549:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399909.345554:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399909.345557:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399909.345608:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.345613:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399909.345628:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.345633:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6d00/0xd95e55596abdf027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606478 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.345645:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399909.345647:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399909.345648:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399909.345654:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399909.345670:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081707072:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1747399909.345846:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399909.345863:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089236672 00000100:00100000:1.0:1747399909.345891:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 139 00000100:00100000:1.0:1747399909.345895:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:3873:x1832281089236672:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399909.345902:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399909.346758:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399909.346766:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:3873:x1832281089236672:12345-192.168.204.160@tcp:104: Request processed in 869us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399909.346772:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 139 00010000:00010000:3.0:1747399909.346858:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399909.346861:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.346867:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399909.346869:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.346883:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399909.346887:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399909.346890:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399909.346916:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.346920:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399909.346927:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.346930:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6ac0/0xd95e55596abdf02e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60647f expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399909.346940:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399909.346941:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399909.346942:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399909.346946:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399909.346954:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081707136:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399909.349156:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081707136:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399909.349188:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081707072:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399909.915620:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399910.920259:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399910.983497:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399910.983502:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 291 10000000:01000000:0.0:1747399910.983507:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399910.983537:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399910.983546:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399910.983554:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399910.983571:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707200:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399910.983636:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753a80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399910.989527:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707200:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399910.989555:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399910.989657:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399910.989740:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707264:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399910.989814:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399910.992447:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707264:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399910.992491:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707328:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399910.992580:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399910.994659:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707328:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399910.996484:0:29372:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29372:1832281081707392:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399910.996570:0:29372:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399910.999354:0:29372:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29372:1832281081707392:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399910.999388:0:29372:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399910.999394:0:29372:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399910.999396:0:29372:0:(obd_config.c:1460:class_process_config()) marker 191 (0x1) lustre-clilov del lustre.6 00000020:01000000:3.0:1747399910.999400:0:29372:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399910.999402:0:29372:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000020:01000000:3.0:1747399910.999440:0:29372:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399910.999442:0:29372:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399910.999442:0:29372:0:(obd_config.c:1460:class_process_config()) marker 191 (0x2) lustre-clilov del lustre.6 00000020:01000000:3.0:1747399910.999444:0:29372:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399910.999445:0:29372:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399910.999446:0:29372:0:(obd_config.c:1460:class_process_config()) marker 193 (0x1) lustre-clilov new lustre.689522837 00000020:01000000:3.0:1747399910.999448:0:29372:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399910.999449:0:29372:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399910.999459:0:29372:0:(lov_pool.c:313:lov_pool_new()) 689522837 is pool #1 00000100:00100000:3.0:1747399910.999483:0:29372:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29372:1832281081707456:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399910.999539:0:29372:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399911.001836:0:29372:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29372:1832281081707456:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399911.001913:0:29372:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399911.001919:0:29372:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399911.001920:0:29372:0:(obd_config.c:1460:class_process_config()) marker 193 (0x2) lustre-clilov new lustre.689522837 00000040:00080000:3.0:1747399911.001924:0:29372:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 297 count 291 00000020:01000000:2.0:1747399911.001986:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 291-296 (rc=0) 10000000:01000000:2.0:1747399911.002007:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399911.002012:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399911.002021:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399911.002029:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399911.002030:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399911.002032:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399911.002052:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399911.002057:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399911.002063:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399911.002077:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707520:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399911.002171:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399911.005824:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707520:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399911.005843:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399911.005859:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399911.005912:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707584:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399911.005959:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb300 going to sleep for 6 seconds 00000100:00100000:2.0:1747399911.007611:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707584:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399911.007645:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399911.007650:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399911.007657:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399911.558999:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399911.559589:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089240448 00000100:00100000:1.0:1747399911.559628:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 140 00000100:00100000:1.0:1747399911.559633:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:10616:x1832281089240448:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399911.559654:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 2/0,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399911.559868:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399911.559874:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:10616:x1832281089240448:12345-192.168.204.160@tcp:104: Request processed in 240us (881us total) trans 0 rc 0/0 00010000:00010000:3.0:1747399911.559879:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1747399911.559880:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 140 00010000:00010000:3.0:1747399911.559883:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 2/0,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399911.559889:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6640 already unused, calling callback (ffffffffa04b1280) 00010000:00010000:3.0:1747399911.559893:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 3/0,0 mode: PR/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399911.559936:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 2/0,0 mode: --/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399911.559941:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399911.559970:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 1/0,0 mode: --/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399911.559976:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f6640/0xd95e55596abdf00b lrc: 0/0,0 mode: --/PR res: [0x4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf60633d expref: -99 pid: 29303 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399911.560038:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399911.560039:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399911.560040:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399911.560046:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399911.560058:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081707648:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399911.561674:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081707648:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399911.919646:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399912.922122:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399913.405385:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399913.405436:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399913.405471:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089243584 00000100:00100000:1.0:1747399913.405482:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089243712 00000100:00100000:0.0:1747399913.405501:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 141 00000100:00100000:0.0:1747399913.405506:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:4176:x1832281089243584:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399913.405517:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399913.406618:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399913.406627:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:4176:x1832281089243584:12345-192.168.204.160@tcp:104: Request processed in 1120us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399913.406632:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 141 00000100:00100000:0.0:1747399913.406647:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 142 00000100:00100000:0.0:1747399913.406650:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:4176:x1832281089243712:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399913.406656:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399913.406691:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399913.406695:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:4176:x1832281089243712:12345-192.168.204.160@tcp:104: Request processed in 44us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399913.406699:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 142 00010000:00010000:2.0:1747399913.406758:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399913.406763:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406769:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399913.406771:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406776:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399913.406781:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399913.406784:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399913.406814:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406818:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399913.406829:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406833:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf03c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6064fd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406854:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399913.406856:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406860:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399913.406861:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406865:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399913.406869:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399913.406872:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399913.406880:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406883:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399913.406885:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406889:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6064f6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399913.406903:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399913.406904:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399913.406905:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399913.406924:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081707776:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399913.406955:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399913.406959:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081707712:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399913.407214:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399913.410541:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081707712:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399913.410711:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081707776:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00080000:2.0:1747399913.643654:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399913.643660:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747399913.643690:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081707840:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399913.643690:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081707904:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399913.647167:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081707904:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399913.648673:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081707840:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399913.923897:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399914.926547:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399915.016445:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399915.016450:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 297 10000000:01000000:0.0:1747399915.016454:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399915.016488:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399915.016495:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399915.016502:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399915.016520:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707968:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399915.016589:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399915.018812:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081707968:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399915.018832:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.018841:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399915.018903:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708032:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399915.018964:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399915.020868:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708032:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399915.020910:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708096:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399915.020975:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399915.022588:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708096:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399915.023041:0:29419:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29419:1832281081708160:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399915.023096:0:29419:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399915.025351:0:29419:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29419:1832281081708160:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399915.025388:0:29419:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399915.025395:0:29419:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399915.025396:0:29419:0:(obd_config.c:1460:class_process_config()) marker 195 (0x1) lustre-clilov add lustre.689522837.lustre-OST0000_UUID 00000020:01000000:3.0:1747399915.025400:0:29419:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399915.025402:0:29419:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399915.025411:0:29419:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to 689522837 as member 1 00000020:01000000:3.0:1747399915.025414:0:29419:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399915.025415:0:29419:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399915.025416:0:29419:0:(obd_config.c:1460:class_process_config()) marker 195 (0x2) lustre-clilov add lustre.689522837.lustre-OST0000_UUID 00000020:01000000:3.0:1747399915.025417:0:29419:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399915.025418:0:29419:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399915.025420:0:29419:0:(obd_config.c:1460:class_process_config()) marker 197 (0x1) lustre-clilov add lustre.689522837.lustre-OST0001_UUID 00000020:01000000:3.0:1747399915.025421:0:29419:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399915.025422:0:29419:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399915.025424:0:29419:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to 689522837 as member 2 00000100:00100000:3.0:1747399915.025443:0:29419:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29419:1832281081708224:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399915.025492:0:29419:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b300 going to sleep for 6 seconds 00000100:00100000:3.0:1747399915.027061:0:29419:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29419:1832281081708224:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399915.027092:0:29419:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399915.027097:0:29419:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399915.027099:0:29419:0:(obd_config.c:1460:class_process_config()) marker 197 (0x2) lustre-clilov add lustre.689522837.lustre-OST0001_UUID 00000040:00080000:3.0:1747399915.027102:0:29419:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 303 count 297 00000020:01000000:2.0:1747399915.027265:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 297-302 (rc=0) 10000000:01000000:2.0:1747399915.027287:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399915.027293:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.027301:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399915.027327:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399915.027329:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399915.027331:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399915.027349:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.027353:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.027359:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399915.027372:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708288:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399915.027407:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399915.028846:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708288:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399915.028863:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.028871:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399915.028916:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708352:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399915.028962:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399915.030599:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081708352:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399915.030632:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399915.030637:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.030645:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.798430:0:29441:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399915.798448:0:29441:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399915.798460:0:29441:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.798471:0:29441:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399915.798478:0:29441:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399915.798480:0:29441:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399915.798484:0:29441:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a993bbb0 00010000:00010000:1.0:1747399915.798486:0:29441:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.798490:0:29441:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.798501:0:29441:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.798507:0:29441:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:1.0:1747399915.798510:0:29441:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.798515:0:29441:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399915.798522:0:29441:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff88012a56e000, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399915.798528:0:29441:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:1.0:1747399915.798539:0:29441:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x200000401:0x10:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399915.798577:0:29441:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.798583:0:29441:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399915.798592:0:29441:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399915.798600:0:29441:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e7200 x1832281081708480/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399915.798607:0:29441:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399915.798622:0:29441:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708480:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399915.799210:0:29441:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e240 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.801670:0:29441:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e7200 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708480:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399915.801688:0:29441:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801702:0:29441:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801708:0:29441:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801715:0:29441:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801728:0:29441:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801737:0:29441:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801742:0:29441:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801747:0:29441:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399915.801754:0:29441:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8801372e7200 x1832281081708480/t4294967346(4294967346) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:1.0:1747399915.801764:0:29441:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e7200 x1832281081708480/t4294967346(4294967346) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1747399915.801772:0:29441:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801779:0:29441:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/16 (0 0) 00000080:00200000:1.0:1747399915.801795:0:29441:0:(namei.c:1416:ll_create_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000080:00200000:1.0:1747399915.801830:0:29441:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8800af2300d8) 00000080:00200000:1.0:1747399915.801835:0:29441:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x10:0x0], updating i_size 0 00000080:00200000:1.0:1747399915.801865:0:29441:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x10:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1747399915.801869:0:29441:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0x10:0x0](ffff8800af2300d8) 00000080:00010000:1.0:1747399915.801871:0:29441:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff8800af2300d8) for lock 0xd95e55596abdf051 00000080:00200000:1.0:1747399915.801882:0:29441:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8800af2300d8), flags 120501 00000002:00100000:1.0:1747399915.801895:0:29441:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e7200 x1832281081708480/t4294967346(4294967346) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:1.0:1747399915.801944:0:29441:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf051 from it ffff88012d57fa20 00010000:00010000:1.0:1747399915.801947:0:29441:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.801952:0:29441:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.801964:0:29441:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8800af2300d8), inode mode 81a4 mask 40 00000080:00200000:1.0:1747399915.801996:0:29441:0:(file.c:4008:ll_file_ioctl()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8800af2300d8), cmd=4008669a 00000002:00010000:1.0:1747399915.802020:0:29441:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x10:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 040000002 00010000:00010000:1.0:1747399915.802051:0:29441:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.802057:0:29441:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399915.802064:0:29441:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399915.802068:0:29441:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e63c0 x1832281081708608/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399915.802074:0:29441:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399915.802088:0:29441:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708608:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399915.802149:0:29441:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e240 going to sleep for 43 seconds 00000100:00100000:0.0:1747399915.804078:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399915.804143:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089245568 00000100:00100000:1.0:1747399915.804187:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 143 00000100:00100000:1.0:1747399915.804192:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:6707:x1832281089245568:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399915.804208:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.804262:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399915.804267:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:6707:x1832281089245568:12345-192.168.204.160@tcp:104: Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399915.804272:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 143 00010000:00010000:3.0:1747399915.804367:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399915.804371:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.804378:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a1c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399915.804381:0:4666:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.804391:0:4666:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.804397:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399915.804417:0:4666:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x10:0x0]: losing layout lock 00010000:00010000:3.0:1747399915.804444:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.804448:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399915.804469:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.804473:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf051 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606600 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.804486:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399915.804487:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399915.804488:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399915.804499:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399915.804509:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081708672:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399915.806140:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081708672:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399915.806885:0:29441:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708608:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399915.806898:0:29441:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806907:0:29441:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806912:0:29441:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806918:0:29441:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806923:0:29441:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806927:0:29441:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459f80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399915.806930:0:29441:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806935:0:29441:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806946:0:29441:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806951:0:29441:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399915.806953:0:29441:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.806957:0:29441:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf058 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399915.806970:0:29441:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8801372e63c0 x1832281081708608/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399915.806978:0:29441:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e63c0 x1832281081708608/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399915.807026:0:29441:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399915.807035:0:29441:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399915.807042:0:29441:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399915.807043:0:29441:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399915.807068:0:29441:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x10:0x0], updating i_size 0 00000002:00100000:1.0:1747399915.807078:0:29441:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e63c0 x1832281081708608/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399915.807091:0:29441:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e63c0 x1832281081708608/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1747399915.807106:0:29441:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399915.807110:0:29441:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6d40 x1832281081708800/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399915.807132:0:29441:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708800:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399915.807182:0:29441:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e600 going to sleep for 6 seconds 00000100:00100000:1.0:1747399915.808680:0:29441:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708800:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399915.808696:0:29441:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e63c0 x1832281081708608/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:1.0:1747399915.808716:0:29441:0:(file.c:6088:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000401:0x10:0x0](ffff8800af2300d8) 00000002:00010000:1.0:1747399915.808722:0:29441:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x10:0x0]) in obj [0x200000401:0x10:0x0], intent: layout flags 0 00010000:00010000:1.0:1747399915.808745:0:29441:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.808752:0:29441:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.808759:0:29441:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1747399915.808770:0:29441:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708864:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399915.808808:0:29441:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e600 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.809987:0:29441:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708864:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399915.810016:0:29441:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.810027:0:29441:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1747399915.810036:0:29441:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8801372e5f00 x1832281081708864/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 376/416 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1747399915.810050:0:29441:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1747399915.810057:0:29441:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.810065:0:29441:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/16 (0 0) 00000080:00010000:1.0:1747399915.810080:0:29441:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff8800af2300d8) for lock 0xd95e55596abdf05f 00000080:00010000:1.0:1747399915.810084:0:29441:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf05f from it ffff8800a993bbf8 00010000:00010000:1.0:1747399915.810449:0:29441:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.810457:0:29441:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.810469:0:29441:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.810476:0:29441:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1747399915.810481:0:29441:0:(file.c:5976:ll_layout_lock_set()) ### file [0x200000401:0x10:0x0](ffff8800af2300d8) being reconfigured ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399915.810511:0:29441:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x10:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:1.0:1747399915.810513:0:29441:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.810518:0:29441:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399915.810563:0:29441:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8800af2300d8) 00000002:00100000:1.0:1747399915.810581:0:29441:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e7200 x1832281081708480/t4294967346(4294967346) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:1.0:1747399915.810597:0:29441:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399915.810601:0:29441:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e5f00 x1832281081708992/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399915.810613:0:29441:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708992:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399915.810661:0:29441:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e600 going to sleep for 6 seconds 00000100:00100000:0.0:1747399915.813816:0:29441:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29441:1832281081708992:192.168.204.160@tcp:35:lfs.0 00000002:00100000:0.0:1747399915.813837:0:29441:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e7200 x1832281081708480/t4294967346(4294967346) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000080:00200000:0.0:1747399915.818867:0:29442:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:0.0:1747399915.818883:0:29442:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399915.818894:0:29442:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399915.818905:0:29442:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1747399915.818913:0:29442:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:0.0:1747399915.818915:0:29442:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:0.0:1747399915.818920:0:29442:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a998fbb0 00010000:00010000:0.0:1747399915.818922:0:29442:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399915.818927:0:29442:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1747399915.818938:0:29442:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399915.818943:0:29442:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:0.0:1747399915.818945:0:29442:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399915.818950:0:29442:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:0.0:1747399915.818953:0:29442:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6674a80, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1747399915.818959:0:29442:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:0.0:1747399915.818968:0:29442:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile2,[0x200000401:0x11:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1747399915.819019:0:29442:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399915.819025:0:29442:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1747399915.819034:0:29442:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1747399915.819042:0:29442:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88013711af80 x1832281081709120/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1747399915.819048:0:29442:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399915.819062:0:29442:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709120:192.168.204.160@tcp:101:lfs.0 00000100:00100000:0.0:1747399915.819168:0:29442:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753180 going to sleep for 43 seconds 00000100:00100000:2.0:1747399915.821867:0:29442:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709120:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399915.821889:0:29442:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821906:0:29442:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821911:0:29442:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821920:0:29442:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821938:0:29442:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821948:0:29442:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821953:0:29442:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821958:0:29442:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399915.821966:0:29442:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff88013711af80 x1832281081709120/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:2.0:1747399915.821974:0:29442:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88013711af80 x1832281081709120/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399915.821982:0:29442:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.821988:0:29442:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/17 (0 0) 00000080:00200000:2.0:1747399915.822004:0:29442:0:(namei.c:1416:ll_create_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000080:00200000:2.0:1747399915.822037:0:29442:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8800af218898) 00000080:00200000:2.0:1747399915.822041:0:29442:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x11:0x0], updating i_size 0 00000080:00200000:2.0:1747399915.822068:0:29442:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x11:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1747399915.822071:0:29442:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0x11:0x0](ffff8800af218898) 00000080:00010000:2.0:1747399915.822073:0:29442:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x11:0x0](ffff8800af218898) for lock 0xd95e55596abdf066 00000080:00200000:2.0:1747399915.822084:0:29442:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8800af218898), flags 120501 00000002:00100000:2.0:1747399915.822097:0:29442:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88013711af80 x1832281081709120/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:2.0:1747399915.822161:0:29442:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf066 from it ffff88012e9e6300 00010000:00010000:2.0:1747399915.822164:0:29442:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.822169:0:29442:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399915.822186:0:29442:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8800af218898), inode mode 81a4 mask 40 00000080:00200000:2.0:1747399915.822225:0:29442:0:(file.c:4008:ll_file_ioctl()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8800af218898), cmd=4008669a 00000002:00010000:2.0:1747399915.822239:0:29442:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x11:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 040000002 00010000:00010000:2.0:1747399915.822280:0:29442:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.822285:0:29442:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399915.822293:0:29442:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399915.822298:0:29442:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aaa140 x1832281081709248/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399915.822304:0:29442:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399915.822370:0:29442:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709248:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399915.822429:0:29442:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb0c0 going to sleep for 43 seconds 00000100:00100000:0.0:1747399915.823568:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399915.823757:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089245632 00000100:00100000:1.0:1747399915.823797:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 144 00000100:00100000:1.0:1747399915.823802:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:6706:x1832281089245632:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399915.823813:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.823869:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399915.823874:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:6706:x1832281089245632:12345-192.168.204.160@tcp:104: Request processed in 71us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399915.823880:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 144 00010000:00010000:3.0:1747399915.823931:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399915.823941:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.823952:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3a80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399915.823968:0:8848:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.823974:0:8848:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.823980:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399915.824014:0:8848:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x11:0x0]: losing layout lock 00010000:00010000:3.0:1747399915.824055:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.824060:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399915.824098:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.824103:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf60663f expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.824129:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399915.824130:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399915.824132:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399915.824150:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399915.824165:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081709312:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399915.828033:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081709312:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399915.828033:0:29442:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709248:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399915.828057:0:29442:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828081:0:29442:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828086:0:29442:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828092:0:29442:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828099:0:29442:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828104:0:29442:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6f40 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399915.828108:0:29442:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828114:0:29442:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828121:0:29442:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828127:0:29442:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399915.828132:0:29442:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.828136:0:29442:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf06d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399915.828162:0:29442:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8800b3aaa140 x1832281081709248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1747399915.828173:0:29442:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aaa140 x1832281081709248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399915.828252:0:29442:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x11:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1747399915.828258:0:29442:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x11:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399915.828267:0:29442:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x11:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1747399915.828269:0:29442:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x11:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399915.828302:0:29442:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x11:0x0], updating i_size 0 00000002:00100000:2.0:1747399915.828344:0:29442:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aaa140 x1832281081709248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1747399915.828362:0:29442:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800b3aaa140 x1832281081709248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:2.0:1747399915.828386:0:29442:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399915.828390:0:29442:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aab440 x1832281081709440/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399915.828409:0:29442:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709440:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747399915.828464:0:29442:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399915.830506:0:29442:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709440:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399915.830534:0:29442:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800b3aaa140 x1832281081709248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399959 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:2.0:1747399915.830564:0:29442:0:(file.c:6088:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000401:0x11:0x0](ffff8800af218898) 00000002:00010000:2.0:1747399915.830572:0:29442:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x11:0x0]) in obj [0x200000401:0x11:0x0], intent: layout flags 0 00010000:00010000:2.0:1747399915.830619:0:29442:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.830627:0:29442:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.830635:0:29442:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1747399915.830649:0:29442:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709504:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399915.830740:0:29442:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 43 seconds 00000100:00100000:2.0:1747399915.831988:0:29442:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709504:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399915.832017:0:29442:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.832028:0:29442:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1747399915.832038:0:29442:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8800b3aabdc0 x1832281081709504/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 376/416 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399915.832046:0:29442:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1747399915.832055:0:29442:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.832063:0:29442:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/17 (0 0) 00000080:00010000:2.0:1747399915.832077:0:29442:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x11:0x0](ffff8800af218898) for lock 0xd95e55596abdf074 00000080:00010000:2.0:1747399915.832082:0:29442:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf074 from it ffff8800a998fbf8 00010000:00010000:2.0:1747399915.832091:0:29442:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.832098:0:29442:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.832112:0:29442:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.832119:0:29442:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1747399915.832124:0:29442:0:(file.c:5976:ll_layout_lock_set()) ### file [0x200000401:0x11:0x0](ffff8800af218898) being reconfigured ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399915.832157:0:29442:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x11:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:2.0:1747399915.832161:0:29442:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.832166:0:29442:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399915.832216:0:29442:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8800af218898) 00000002:00100000:2.0:1747399915.832236:0:29442:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88013711af80 x1832281081709120/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:2.0:1747399915.832254:0:29442:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399915.832258:0:29442:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aabdc0 x1832281081709632/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399915.832270:0:29442:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709632:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747399915.832612:0:29442:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399915.834159:0:29442:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29442:1832281081709632:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399915.834182:0:29442:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88013711af80 x1832281081709120/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000080:00200000:1.0:1747399915.838706:0:29443:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399915.838727:0:29443:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399915.838742:0:29443:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.838756:0:29443:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399915.838775:0:29443:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399915.838778:0:29443:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399915.838784:0:29443:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27b58 00010000:00010000:1.0:1747399915.838787:0:29443:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.838793:0:29443:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.838806:0:29443:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.838813:0:29443:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399915.838816:0:29443:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.838821:0:29443:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=1536 00000080:00200000:1.0:1747399915.838824:0:29443:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399915.838827:0:29443:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399915.838830:0:29443:0:(namei.c:1935:ll_mkdir()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00000020:00100000:1.0:1747399915.838880:0:29443:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399915.838890:0:29443:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e6880 x1832281081709760/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399915.838910:0:29443:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29443:1832281081709760:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:1.0:1747399915.838993:0:29443:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.841932:0:29443:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e6880 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29443:1832281081709760:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:1.0:1747399915.841971:0:29443:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898) 00000080:00200000:1.0:1747399915.841977:0:29443:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x12:0x0], updating i_size 512 00000080:00200000:3.0:1747399915.850937:0:29444:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399915.850961:0:29444:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399915.850978:0:29444:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.850996:0:29444:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399915.851021:0:29444:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399915.851023:0:29444:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399915.851030:0:29444:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a993bbb0 00010000:00010000:3.0:1747399915.851032:0:29444:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.851039:0:29444:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399915.851052:0:29444:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399915.851061:0:29444:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:3.0:1747399915.851063:0:29444:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399915.851070:0:29444:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399915.851074:0:29444:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6f6d800, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1747399915.851082:0:29444:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:3.0:1747399915.851095:0:29444:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x200000401:0x13:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1747399915.851150:0:29444:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.851156:0:29444:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399915.851168:0:29444:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399915.851182:0:29444:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62ac0 x1832281081709888/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399915.851193:0:29444:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399915.851213:0:29444:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081709888:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399915.851455:0:29444:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 43 seconds 00000100:00100000:3.0:1747399915.853029:0:29444:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081709888:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399915.853046:0:29444:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853056:0:29444:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853060:0:29444:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853063:0:29444:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853067:0:29444:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853070:0:29444:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b221c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399915.853073:0:29444:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853076:0:29444:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853088:0:29444:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 5/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853092:0:29444:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399915.853095:0:29444:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853098:0:29444:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b221c0/0xd95e55596abdf07b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399915.853108:0:29444:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff88012bf62ac0 x1832281081709888/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399915.853204:0:29444:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399915.853215:0:29444:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399915.853224:0:29444:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853231:0:29444:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399915.853237:0:29444:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399915.853239:0:29444:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399915.853242:0:29444:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a993bbb0 00010000:00010000:3.0:1747399915.853243:0:29444:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853251:0:29444:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399915.853273:0:29444:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399915.853278:0:29444:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=19 00000080:00200000:3.0:1747399915.853280:0:29444:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399915.853286:0:29444:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6f6c780, open_flags 1a100, mode 0 opened 0 00000080:00200000:3.0:1747399915.853289:0:29444:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open 00000002:00010000:3.0:1747399915.853294:0:29444:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 0320401 00010000:00010000:3.0:1747399915.853341:0:29444:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.853345:0:29444:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399915.853351:0:29444:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399915.853355:0:29444:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62ac0 x1832281081710016/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399915.853358:0:29444:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399915.853370:0:29444:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081710016:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399915.853433:0:29444:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 43 seconds 00000100:00100000:3.0:1747399915.858031:0:29444:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081710016:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399915.858055:0:29444:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858069:0:29444:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858088:0:29444:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858093:0:29444:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858100:0:29444:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858105:0:29444:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21f80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399915.858109:0:29444:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858115:0:29444:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858120:0:29444:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858126:0:29444:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399915.858130:0:29444:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399915.858134:0:29444:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21f80/0xd95e55596abdf082 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29444 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399915.858151:0:29444:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf62ac0 x1832281081710016/t4294967355(4294967355) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399915.858169:0:29444:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62ac0 x1832281081710016/t4294967355(4294967355) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399915.858201:0:29444:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x12:0x0], updating i_size 512 00000080:00200000:3.0:1747399915.858204:0:29444:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x12:0x0](ffff8800af230898): rc = 0 00000080:00010000:3.0:1747399915.858209:0:29444:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x12:0x0](ffff8800af230898) for lock 0x0 00000080:00200000:3.0:1747399915.858231:0:29444:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898), flags 320400 00000002:00100000:3.0:1747399915.858245:0:29444:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62ac0 x1832281081710016/t4294967355(4294967355) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399915.858344:0:29444:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898), inode mode 41ed mask 44 00000080:00200000:3.0:1747399915.858387:0:29444:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898), cmd=0x4008669a 00000020:00100000:3.0:1747399915.858428:0:29444:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399915.858433:0:29444:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62600 x1832281081710144/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399915.858451:0:29444:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081710144:192.168.204.160@tcp:36:lfs.0 00000100:00100000:3.0:1747399915.858528:0:29444:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 43 seconds 00000100:00100000:3.0:1747399915.860588:0:29444:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081710144:192.168.204.160@tcp:36:lfs.0 00000080:00200000:3.0:1747399915.860638:0:29444:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898) 00000002:00100000:3.0:1747399915.860669:0:29444:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf62ac0 x1832281081710016/t4294967355(4294967355) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:3.0:1747399915.860690:0:29444:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399915.860694:0:29444:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf61c80 x1832281081710272/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399915.860709:0:29444:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081710272:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399915.860746:0:29444:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747399915.864034:0:29444:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29444:1832281081710272:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747399915.864068:0:29444:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf62ac0 x1832281081710016/t4294967355(4294967355) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1747399915.871356:0:29445:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399915.871377:0:29445:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399915.871393:0:29445:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.871403:0:29445:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399915.871411:0:29445:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399915.871412:0:29445:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399915.871418:0:29445:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27bb0 00010000:00010000:1.0:1747399915.871420:0:29445:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.871424:0:29445:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.871436:0:29445:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.871442:0:29445:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:1.0:1747399915.871443:0:29445:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.871449:0:29445:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399915.871452:0:29445:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6e64780, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399915.871457:0:29445:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:1.0:1747399915.871467:0:29445:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x200000401:0x14:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399915.871513:0:29445:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.871517:0:29445:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399915.871526:0:29445:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399915.871537:0:29445:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e76c0 x1832281081710400/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399915.871543:0:29445:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399915.871559:0:29445:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710400:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399915.871695:0:29445:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.874034:0:29445:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710400:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399915.874053:0:29445:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874065:0:29445:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874070:0:29445:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874075:0:29445:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874081:0:29445:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874086:0:29445:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a1c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399915.874090:0:29445:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874095:0:29445:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874111:0:29445:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 5/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874117:0:29445:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399915.874121:0:29445:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874125:0:29445:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf089 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399915.874139:0:29445:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff8801372e76c0 x1832281081710400/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399915.874267:0:29445:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399915.874283:0:29445:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399915.874296:0:29445:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874303:0:29445:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399915.874338:0:29445:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399915.874341:0:29445:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399915.874345:0:29445:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27bb0 00010000:00010000:1.0:1747399915.874347:0:29445:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874353:0:29445:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.874373:0:29445:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.874379:0:29445:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=19 00000080:00200000:1.0:1747399915.874382:0:29445:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.874395:0:29445:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6e64c00, open_flags 1a100, mode 0 opened 0 00000080:00200000:1.0:1747399915.874400:0:29445:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open 00000002:00010000:1.0:1747399915.874407:0:29445:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 0320401 00010000:00010000:1.0:1747399915.874444:0:29445:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.874450:0:29445:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399915.874459:0:29445:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399915.874468:0:29445:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801372e76c0 x1832281081710528/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399915.874474:0:29445:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399915.874490:0:29445:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710528:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399915.874572:0:29445:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.876534:0:29445:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372e76c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710528:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399915.876549:0:29445:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876558:0:29445:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876571:0:29445:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876574:0:29445:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876578:0:29445:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876580:0:29445:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459680 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399915.876582:0:29445:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876585:0:29445:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876589:0:29445:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876592:0:29445:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399915.876594:0:29445:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.876597:0:29445:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf090 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29445 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399915.876606:0:29445:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8801372e76c0 x1832281081710528/t4294967358(4294967358) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399915.876619:0:29445:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e76c0 x1832281081710528/t4294967358(4294967358) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399915.876641:0:29445:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x12:0x0], updating i_size 512 00000080:00200000:1.0:1747399915.876642:0:29445:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x12:0x0](ffff8800af230898): rc = 0 00000080:00010000:1.0:1747399915.876646:0:29445:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x12:0x0](ffff8800af230898) for lock 0x0 00000080:00200000:1.0:1747399915.876662:0:29445:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898), flags 320400 00000002:00100000:1.0:1747399915.876676:0:29445:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8801372e76c0 x1832281081710528/t4294967358(4294967358) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399915.876735:0:29445:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898), inode mode 41ed mask 44 00000080:00200000:1.0:1747399915.876775:0:29445:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898), cmd=0x4008669a 00000020:00100000:1.0:1747399915.876823:0:29445:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399915.876827:0:29445:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af0000 x1832281081710656/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399915.876843:0:29445:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af0000 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710656:192.168.204.160@tcp:36:lfs.0 00000100:00100000:1.0:1747399915.876901:0:29445:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.878735:0:29445:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af0000 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710656:192.168.204.160@tcp:36:lfs.0 00000080:00200000:1.0:1747399915.878786:0:29445:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898) 00000002:00100000:1.0:1747399915.878814:0:29445:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8801372e76c0 x1832281081710528/t4294967358(4294967358) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747399915.878836:0:29445:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399915.878839:0:29445:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af04c0 x1832281081710784/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399915.878853:0:29445:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710784:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399915.878897:0:29445:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 6 seconds 00000100:00100000:1.0:1747399915.880109:0:29445:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29445:1832281081710784:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399915.880128:0:29445:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8801372e76c0 x1832281081710528/t4294967358(4294967358) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1747399915.883819:0:29446:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399915.883841:0:29446:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399915.883856:0:29446:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.883870:0:29446:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399915.883879:0:29446:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399915.883881:0:29446:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399915.883887:0:29446:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a993baf8 00010000:00010000:1.0:1747399915.883889:0:29446:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.883895:0:29446:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.883908:0:29446:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.883914:0:29446:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399915.883916:0:29446:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.883921:0:29446:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:1.0:1747399915.883925:0:29446:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:1.0:1747399915.883931:0:29446:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1747399915.883970:0:29446:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.883982:0:29446:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.883990:0:29446:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399915.884022:0:29446:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29446:1832281081710848:192.168.204.160@tcp:101:rm.0 00000100:00100000:1.0:1747399915.884105:0:29446:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.887858:0:29446:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29446:1832281081710848:192.168.204.160@tcp:101:rm.0 00010000:00010000:1.0:1747399915.887881:0:29446:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.887896:0:29446:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.887902:0:29446:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.887910:0:29446:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.887918:0:29446:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.887927:0:29446:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.887933:0:29446:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.887949:0:29446:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399915.887958:0:29446:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a9af04c0 x1832281081710848/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/712 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:1.0:1747399915.887966:0:29446:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1747399915.887976:0:29446:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.887985:0:29446:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/16 (0 0) 00000080:00200000:1.0:1747399915.888045:0:29446:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x10:0x0](ffff8800af2300d8): rc = 0 00000080:00200000:1.0:1747399915.888054:0:29446:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x10:0x0]: layout version change: 0 -> 0 00000080:00010000:1.0:1747399915.888058:0:29446:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff8800af2300d8) for lock 0xd95e55596abdf097 00000080:00010000:1.0:1747399915.888069:0:29446:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x10:0x0](ffff8800af2300d8) 00000080:00010000:1.0:1747399915.888071:0:29446:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf097 from it ffff8800a993bbb8 00010000:00010000:1.0:1747399915.888073:0:29446:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.888079:0:29446:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399915.888110:0:29446:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8800af2300d8),name=testfile1 00000002:00010000:1.0:1747399915.888121:0:29446:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x10:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1747399915.888127:0:29446:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.888142:0:29446:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1747399915.888149:0:29446:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x10:0x0](ffff8800af2300d8) 00000080:00010000:1.0:1747399915.888151:0:29446:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff8800af2300d8) for lock 0xd95e55596abdf097 00000080:00010000:1.0:1747399915.888154:0:29446:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf097 from it ffff8800a993bcf8 00010000:00010000:1.0:1747399915.888155:0:29446:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.888159:0:29446:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399915.888174:0:29446:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x10:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1747399915.888183:0:29446:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000401:0x10:0x0] 00000008:00010000:1.0:1747399915.888207:0:29446:0:(lustre_osc.h:181:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1747399915.888210:0:29446:0:(osc_lock.c:1241:osc_lock_init()) ### lock ffff8800b3a300b0, osc lock ffff8800ab4e8000, flags 0x400001002 00010000:00010000:1.0:1747399915.888233:0:29446:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 3/1,0 mode: --/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.888240:0:29446:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 3/1,0 mode: --/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1747399915.888305:0:1862:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1747399915.888339:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081710912:192.168.204.160@tcp:101:rm.0 00010000:00010000:1.0:1747399915.890157:0:1862:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 6/2,0 mode: --/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.890187:0:1862:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 6/2,0 mode: --/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.890197:0:1862:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 6/2,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.890207:0:1862:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 6/2,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1747399915.890219:0:1862:0:(osc_lock.c:196:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 5/2,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.890248:0:1862:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 6/2,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.890254:0:1862:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 5/1,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.890259:0:1862:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 5/1,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.890264:0:1862:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 4/0,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1747399915.890278:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081710912:192.168.204.160@tcp:101:rm.0 00000080:00200000:2.0:1747399915.891165:0:29446:0:(file.c:1496:ll_merge_attr()) [0x200000401:0x10:0x0] updating i_size 0 00000020:00010000:2.0:1747399915.891172:0:29446:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff88012b4748e0 (ffff88012b753248/0) at cl_lock_release():234 00000020:00010000:2.0:1747399915.891176:0:29446:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff88012b4748e0 (ffff88012b753248/0) at cl_lock_cancel():151 00000020:00010000:2.0:1747399915.891181:0:29446:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b3a300b0 (ffff88012b753368/1) at cl_lock_cancel():151 00000020:00010000:2.0:1747399915.891185:0:29446:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff88012b4748e0 (ffff88012b753248/0) at cl_lock_fini():84 00000020:00010000:2.0:1747399915.891187:0:29446:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b3a300b0 (ffff88012b753248/1) at cl_lock_fini():84 00000080:00200000:2.0:1747399915.891201:0:29446:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x10:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399915.891295:0:29446:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399915.891337:0:29446:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399915.891351:0:29446:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.891362:0:29446:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399915.891371:0:29446:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399915.891373:0:29446:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399915.891378:0:29446:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a993bb90 00010000:00010000:2.0:1747399915.891381:0:29446:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.891385:0:29446:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399915.891406:0:29446:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399915.891413:0:29446:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:2.0:1747399915.891416:0:29446:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399915.891421:0:29446:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=testfile1, flags=0 00000080:00200000:2.0:1747399915.891423:0:29446:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399915.891428:0:29446:0:(namei.c:2063:ll_unlink()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:2.0:1747399915.891454:0:29446:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399915.891469:0:29446:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x10:0x0]: losing layout lock 00010000:00010000:2.0:1747399915.891480:0:29446:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399915.891487:0:29446:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x10:0x0]: losing layout lock 00010000:00010000:2.0:1747399915.891512:0:29446:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.891517:0:29446:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.891521:0:29446:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1747399915.891523:0:29446:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf097 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf6066fc expref: -99 pid: 29446 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.891558:0:29446:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf05f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606623 expref: -99 pid: 29441 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1747399915.891576:0:29446:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399915.891584:0:29446:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aac280 x1832281081711040/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399915.891609:0:29446:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29446:1832281081711040:192.168.204.160@tcp:36:rm.0 00000100:00100000:2.0:1747399915.891680:0:29446:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 43 seconds 00000100:00100000:2.0:1747399915.895885:0:29446:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29446:1832281081711040:192.168.204.160@tcp:36:rm.0 00000080:00200000:2.0:1747399915.895958:0:29446:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1747399915.895970:0:29446:0:(lov_io.c:825:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1747399915.895996:0:29446:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399915.896001:0:29446:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8800af2300d8) 00000008:00010000:2.0:1747399915.896040:0:29446:0:(osc_object.c:224:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 0 blocks 1 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 1/0,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1747399915.901137:0:29447:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399915.901163:0:29447:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399915.901178:0:29447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.901192:0:29447:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399915.901202:0:29447:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399915.901205:0:29447:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399915.901211:0:29447:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27af8 00010000:00010000:1.0:1747399915.901213:0:29447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.901219:0:29447:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399915.901232:0:29447:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.901240:0:29447:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399915.901243:0:29447:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399915.901249:0:29447:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:1.0:1747399915.901253:0:29447:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:1.0:1747399915.901259:0:29447:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile2,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1747399915.901303:0:29447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.901332:0:29447:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.901351:0:29447:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399915.901376:0:29447:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29447:1832281081711104:192.168.204.160@tcp:101:rm.0 00000100:00100000:1.0:1747399915.901459:0:29447:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e900 going to sleep for 43 seconds 00000100:00100000:1.0:1747399915.903365:0:29447:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29447:1832281081711104:192.168.204.160@tcp:101:rm.0 00010000:00010000:1.0:1747399915.903385:0:29447:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.903397:0:29447:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.903402:0:29447:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.903411:0:29447:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.903420:0:29447:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.903428:0:29447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.903433:0:29447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399915.903437:0:29447:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399915.903454:0:29447:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a9af04c0 x1832281081711104/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/712 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:1.0:1747399915.903462:0:29447:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1747399915.903473:0:29447:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.903481:0:29447:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/17 (0 0) 00000080:00200000:1.0:1747399915.903526:0:29447:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x11:0x0](ffff8800af218898): rc = 0 00000080:00200000:1.0:1747399915.903536:0:29447:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x11:0x0]: layout version change: 0 -> 0 00000080:00010000:1.0:1747399915.903541:0:29447:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x11:0x0](ffff8800af218898) for lock 0xd95e55596abdf0a5 00000080:00010000:1.0:1747399915.903550:0:29447:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x11:0x0](ffff8800af218898) 00000080:00010000:1.0:1747399915.903551:0:29447:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf0a5 from it ffff8800a9a27bb8 00010000:00010000:1.0:1747399915.903553:0:29447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.903559:0:29447:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399915.903591:0:29447:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8800af218898),name=testfile2 00000002:00010000:1.0:1747399915.903603:0:29447:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x11:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1747399915.903608:0:29447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.903615:0:29447:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1747399915.903630:0:29447:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x11:0x0](ffff8800af218898) 00000080:00010000:1.0:1747399915.903632:0:29447:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x11:0x0](ffff8800af218898) for lock 0xd95e55596abdf0a5 00000080:00010000:1.0:1747399915.903635:0:29447:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf0a5 from it ffff8800a9a27cf8 00010000:00010000:1.0:1747399915.903636:0:29447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399915.903641:0:29447:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399915.903657:0:29447:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x11:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1747399915.903666:0:29447:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000401:0x11:0x0] 00000008:00010000:1.0:1747399915.903707:0:29447:0:(lustre_osc.h:181:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1747399915.903709:0:29447:0:(osc_lock.c:1241:osc_lock_init()) ### lock ffff8800b3a30030, osc lock ffff8800ab4e8130, flags 0x400001002 00010000:00010000:1.0:1747399915.903730:0:29447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 3/1,0 mode: --/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.903736:0:29447:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 3/1,0 mode: --/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1747399915.903797:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1747399915.903810:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081711168:192.168.204.160@tcp:101:rm.0 00010000:00010000:1.0:1747399915.906688:0:1863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 6/2,0 mode: --/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.906710:0:1863:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 6/2,0 mode: --/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.906735:0:1863:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 6/2,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.906743:0:1863:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 6/2,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1747399915.906755:0:1863:0:(osc_lock.c:196:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 5/2,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.906783:0:1863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 6/2,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.906789:0:1863:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 5/1,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.906794:0:1863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 5/1,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399915.906799:0:1863:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 4/0,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1747399915.906816:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081711168:192.168.204.160@tcp:101:rm.0 00000080:00200000:2.0:1747399915.906880:0:29447:0:(file.c:1496:ll_merge_attr()) [0x200000401:0x11:0x0] updating i_size 0 00000020:00010000:2.0:1747399915.906886:0:29447:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff88012b474d50 (ffff88012b753488/0) at cl_lock_release():234 00000020:00010000:2.0:1747399915.906889:0:29447:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff88012b474d50 (ffff88012b753488/0) at cl_lock_cancel():151 00000020:00010000:2.0:1747399915.906893:0:29447:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b3a30030 (ffff88012b7535a8/1) at cl_lock_cancel():151 00000020:00010000:2.0:1747399915.906896:0:29447:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff88012b474d50 (ffff88012b753488/0) at cl_lock_fini():84 00000020:00010000:2.0:1747399915.906897:0:29447:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b3a30030 (ffff88012b753488/1) at cl_lock_fini():84 00000080:00200000:2.0:1747399915.906909:0:29447:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x11:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399915.906997:0:29447:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399915.907027:0:29447:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399915.907037:0:29447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.907046:0:29447:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399915.907055:0:29447:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399915.907063:0:29447:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399915.907067:0:29447:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a27b90 00010000:00010000:2.0:1747399915.907069:0:29447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.907075:0:29447:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399915.907083:0:29447:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399915.907089:0:29447:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:2.0:1747399915.907092:0:29447:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399915.907098:0:29447:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=testfile2, flags=0 00000080:00200000:2.0:1747399915.907100:0:29447:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399915.907105:0:29447:0:(namei.c:2063:ll_unlink()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:2.0:1747399915.907129:0:29447:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399915.907144:0:29447:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x11:0x0]: losing layout lock 00010000:00010000:2.0:1747399915.907154:0:29447:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399915.907161:0:29447:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x11:0x0]: losing layout lock 00010000:00010000:2.0:1747399915.907183:0:29447:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.907188:0:29447:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.907193:0:29447:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1747399915.907194:0:29447:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf0a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf60673b expref: -99 pid: 29447 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399915.907213:0:29447:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f73c0/0xd95e55596abdf074 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606662 expref: -99 pid: 29442 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1747399915.907230:0:29447:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399915.907378:0:29447:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aac740 x1832281081711296/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399915.907394:0:29447:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29447:1832281081711296:192.168.204.160@tcp:36:rm.0 00000100:00100000:2.0:1747399915.907448:0:29447:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 43 seconds 00000100:00100000:2.0:1747399915.910216:0:29447:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29447:1832281081711296:192.168.204.160@tcp:36:rm.0 00000080:00200000:2.0:1747399915.910273:0:29447:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x11:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1747399915.910285:0:29447:0:(lov_io.c:825:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1747399915.910339:0:29447:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x11:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399915.910345:0:29447:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8800af218898) 00000008:00010000:2.0:1747399915.910374:0:29447:0:(osc_object.c:224:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 0 blocks 1 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 1/0,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1747399915.913723:0:29448:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399915.913747:0:29448:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399915.913763:0:29448:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.913776:0:29448:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399915.913786:0:29448:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399915.913793:0:29448:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399915.913800:0:29448:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a993bb98 00010000:00010000:2.0:1747399915.913803:0:29448:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.913808:0:29448:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399915.913822:0:29448:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399915.913830:0:29448:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:2.0:1747399915.913833:0:29448:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399915.913841:0:29448:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:2.0:1747399915.913845:0:29448:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:2.0:1747399915.913852:0:29448:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1747399915.913972:0:29448:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.913978:0:29448:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.913986:0:29448:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399915.914021:0:29448:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29448:1832281081711360:192.168.204.160@tcp:101:rmdir.0 00000100:00100000:2.0:1747399915.914111:0:29448:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 43 seconds 00000100:00100000:2.0:1747399915.918360:0:29448:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29448:1832281081711360:192.168.204.160@tcp:101:rmdir.0 00010000:00010000:2.0:1747399915.918383:0:29448:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918412:0:29448:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918421:0:29448:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918430:0:29448:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918439:0:29448:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918448:0:29448:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918454:0:29448:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918459:0:29448:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399915.918467:0:29448:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800b3aacc00 x1832281081711360/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747399959 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rmdir.0' 00000002:00010000:2.0:1747399915.918477:0:29448:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918485:0:29448:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/18 (0 0) 00000080:00200000:2.0:1747399915.918510:0:29448:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x12:0x0], updating i_size 512 00000080:00200000:2.0:1747399915.918517:0:29448:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x12:0x0](ffff8800af230898): rc = 0 00000080:00010000:2.0:1747399915.918524:0:29448:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x12:0x0](ffff8800af230898) for lock 0xd95e55596abdf0b3 00000080:00010000:2.0:1747399915.918534:0:29448:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x12:0x0](ffff8800af230898) 00000080:00010000:2.0:1747399915.918537:0:29448:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf0b3 from it ffff8800a993bd90 00010000:00010000:2.0:1747399915.918539:0:29448:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918545:0:29448:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399915.918576:0:29448:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399915.918586:0:29448:0:(namei.c:1967:ll_rmdir()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:2.0:1747399915.918605:0:29448:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918651:0:29448:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399915.918656:0:29448:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399915.918657:0:29448:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6f40/0xd95e55596abdf0b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf60677a expref: -99 pid: 29448 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399915.918711:0:29448:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399915.918716:0:29448:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aacc00 x1832281081711488/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399915.918736:0:29448:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29448:1832281081711488:192.168.204.160@tcp:36:rmdir.0 00000100:00100000:2.0:1747399915.918891:0:29448:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 43 seconds 00000100:00100000:3.0:1747399915.922411:0:29448:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29448:1832281081711488:192.168.204.160@tcp:36:rmdir.0 00000080:00200000:3.0:1747399915.922452:0:29448:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0x12:0x0](ffff8800af230898) 00010000:00010000:2.0:1747399915.927450:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399916.536255:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399916.536306:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399916.536367:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1747399916.536382:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089246464 00000100:00100000:0.0:1747399916.536407:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089246656 00000100:00100000:0.0:1747399916.536416:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 145 00000100:00100000:0.0:1747399916.536420:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:4385:x1832281089246464:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399916.536433:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399916.536500:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399916.536504:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:4385:x1832281089246464:12345-192.168.204.160@tcp:104: Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399916.536519:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 145 00000100:00100000:0.0:1747399916.536532:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 146 00000100:00100000:0.0:1747399916.536535:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:4385:x1832281089246656:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399916.536540:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399916.536568:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399916.536571:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:4385:x1832281089246656:12345-192.168.204.160@tcp:104: Request processed in 36us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399916.536574:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 146 00010000:00010000:3.0:1747399916.536836:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399916.536840:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536846:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399916.536848:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536853:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399916.536857:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399916.536861:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399916.536898:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536903:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399916.536915:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536919:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf04a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606582 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536930:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399916.536936:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536940:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399916.536942:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536945:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399916.536949:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399916.536952:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399916.536960:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536963:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399916.536966:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536970:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60657b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399916.536978:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399916.536979:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399916.536985:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399916.537007:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081711552:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399916.537040:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399916.537045:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081711616:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399916.537118:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399916.539197:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081711616:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399916.539215:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081711552:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399916.930142:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399916.963527:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399916.963645:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089246784 00000100:00100000:1.0:1747399916.963687:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 147 00000100:00100000:1.0:1747399916.963693:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:10616:x1832281089246784:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399916.963720:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 2/0,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399916.963798:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399916.963803:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:10616:x1832281089246784:12345-192.168.204.160@tcp:104: Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399916.963809:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 147 00010000:00010000:3.0:1747399916.963936:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399916.963942:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 2/0,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399916.963949:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459b00 already unused, calling callback (ffffffffa04b1280) 00010000:00010000:3.0:1747399916.963953:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 3/0,0 mode: PR/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399916.964004:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 2/0,0 mode: --/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399916.964010:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399916.964123:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 1/0,0 mode: --/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399916.964129:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b459b00/0xd95e55596abdf09e lrc: 0/0,0 mode: --/PR res: [0x5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606703 expref: -99 pid: 29446 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1747399916.964212:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081711680:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399916.964551:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399916.964553:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399916.964554:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399916.967221:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081711680:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399917.931613:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399918.329770:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399918.329777:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 303 10000000:01000000:0.0:1747399918.329782:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399918.329820:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399918.329829:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399918.329837:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399918.329860:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081711744:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399918.329944:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753e40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399918.333503:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081711744:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399918.333523:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.333533:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399918.333598:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081711808:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399918.333654:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399918.335779:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081711808:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399918.335820:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081711872:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399918.335880:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399918.337246:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081711872:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399918.337852:0:29471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29471:1832281081711936:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399918.337904:0:29471:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399918.340068:0:29471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29471:1832281081711936:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399918.340105:0:29471:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399918.340117:0:29471:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399918.340119:0:29471:0:(obd_config.c:1460:class_process_config()) marker 199 (0x1) lustre-clilov rem lustre.689522837.lustre-OST0000_UUID 00000020:01000000:3.0:1747399918.340123:0:29471:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399918.340125:0:29471:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399918.340135:0:29471:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from 689522837 00000100:00100000:3.0:1747399918.340158:0:29471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29471:1832281081712000:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399918.340217:0:29471:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399918.342198:0:29471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29471:1832281081712000:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399918.342224:0:29471:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399918.342229:0:29471:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399918.342230:0:29471:0:(obd_config.c:1460:class_process_config()) marker 199 (0x2) lustre-clilov rem lustre.689522837.lustre-OST0000_UUID 00000040:00080000:3.0:1747399918.342233:0:29471:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 306 count 300 00000020:01000000:2.0:1747399918.342397:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 303-305 (rc=0) 10000000:01000000:2.0:1747399918.342422:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399918.342428:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.342438:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399918.342455:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399918.342457:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399918.342459:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399918.342480:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.342485:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.342492:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399918.342506:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712064:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399918.342599:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399918.343994:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712064:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399918.344010:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.344018:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399918.344067:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712128:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399918.344192:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399918.346079:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712128:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399918.346440:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399918.346448:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.346467:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1747399918.651784:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399918.651790:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399918.651818:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081712256:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399918.651819:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081712192:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399918.653607:0:1865:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967363 gen 1 00000100:00100000:3.0:1747399918.653771:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081712192:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399918.653964:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081712256:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399918.828436:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399918.828476:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399918.828511:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089249088 00000100:00100000:1.0:1747399918.828533:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089249152 00000100:00100000:0.0:1747399918.828544:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 148 00000100:00100000:0.0:1747399918.828547:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:4476:x1832281089249088:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399918.828558:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399918.828653:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399918.828658:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:4476:x1832281089249088:12345-192.168.204.160@tcp:104: Request processed in 110us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399918.828664:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 148 00000100:00100000:0.0:1747399918.828675:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 149 00000100:00100000:0.0:1747399918.828678:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:4476:x1832281089249152:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399918.828684:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.828720:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399918.828724:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.828729:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399918.828732:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.828737:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399918.828741:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399918.828744:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399918.828911:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.828916:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1747399918.828965:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399918.828970:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:4476:x1832281089249152:12345-192.168.204.160@tcp:104: Request processed in 290us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399918.828975:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 149 00010000:00010000:3.0:1747399918.828981:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399918.828984:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399918.828989:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399918.828991:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399918.828995:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399918.828999:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399918.829008:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399918.829013:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.829022:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60680d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399918.829031:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399918.829035:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399918.829039:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399918.829039:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399918.829040:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399918.829041:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399918.829042:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3840/0xd95e55596abdf0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606806 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399918.829053:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081712384:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399918.829054:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399918.829054:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399918.829056:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399918.829065:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081712320:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399918.830103:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081712320:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399918.830217:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081712384:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1747399918.933575:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399919.936293:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399920.143423:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399920.143428:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 306 10000000:01000000:0.0:1747399920.143432:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399920.143467:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399920.143475:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399920.143487:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399920.143516:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712448:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399920.143581:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399920.145514:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712448:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399920.145531:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399920.145539:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399920.145589:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712512:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399920.145634:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399920.147123:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712512:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399920.147160:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712576:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399920.147208:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399920.149838:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712576:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399920.150169:0:29481:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29481:1832281081712640:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399920.150223:0:29481:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399920.153253:0:29481:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29481:1832281081712640:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399920.153286:0:29481:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399920.153294:0:29481:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399920.153295:0:29481:0:(obd_config.c:1460:class_process_config()) marker 201 (0x1) lustre-clilov rem lustre.689522837.lustre-OST0001_UUID 00000020:01000000:3.0:1747399920.153299:0:29481:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399920.153301:0:29481:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399920.153366:0:29481:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from 689522837 00000100:00100000:3.0:1747399920.153404:0:29481:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29481:1832281081712704:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399920.153464:0:29481:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399920.155201:0:29481:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29481:1832281081712704:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399920.155230:0:29481:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399920.155235:0:29481:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399920.155236:0:29481:0:(obd_config.c:1460:class_process_config()) marker 201 (0x2) lustre-clilov rem lustre.689522837.lustre-OST0001_UUID 00000040:00080000:3.0:1747399920.155239:0:29481:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 310 count 303 00000020:01000000:2.0:1747399920.155427:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 306-309 (rc=0) 10000000:01000000:2.0:1747399920.155451:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399920.155456:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399920.155465:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399920.155473:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399920.155475:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399920.155477:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399920.155494:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399920.155498:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399920.155504:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399920.155514:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712768:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399920.155546:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399920.157354:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712768:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399920.157370:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399920.157378:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399920.157425:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712832:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399920.157467:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399920.159096:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081712832:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399920.159132:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399920.159138:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399920.159145:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399920.938020:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399921.443762:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399921.444049:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399921.444249:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089251968 00000100:00100000:1.0:1747399921.444275:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089252032 00000100:00100000:1.0:1747399921.444284:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 150 00000100:00100000:1.0:1747399921.444289:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:4617:x1832281089251968:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399921.444300:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399921.444622:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399921.444627:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:4617:x1832281089251968:12345-192.168.204.160@tcp:104: Request processed in 338us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399921.444633:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 150 00000100:00100000:1.0:1747399921.444647:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 151 00000100:00100000:1.0:1747399921.444650:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:4617:x1832281089252032:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399921.444655:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399921.444693:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399921.444696:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:4617:x1832281089252032:12345-192.168.204.160@tcp:104: Request processed in 45us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399921.444709:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 151 00010000:00010000:2.0:1747399921.444753:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399921.444756:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.444761:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399921.444763:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.444773:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399921.444778:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399921.444784:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399921.444790:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399921.444797:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399921.444806:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3cc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399921.444808:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399921.444815:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.444815:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.444819:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1747399921.444820:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399921.444825:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399921.444833:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.444838:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606884 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399921.444861:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399921.444864:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399921.444868:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399921.444869:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399921.444871:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399921.444873:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399921.444877:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60687d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399921.444886:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081712960:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399921.444931:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399921.444932:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399921.444933:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1747399921.444934:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399921.444938:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081712896:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399921.446260:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081712896:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399921.446269:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081712960:192.168.204.160@tcp:103:ldlm_bl_01.0 10000000:01000000:0.0:1747399921.588511:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399921.588517:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 310 10000000:01000000:0.0:1747399921.588521:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399921.588556:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399921.588565:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399921.588573:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399921.588592:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713024:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399921.588667:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399921.590470:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713024:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399921.590487:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.590496:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399921.590559:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713088:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399921.590650:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399921.592077:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713088:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399921.592118:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713152:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399921.592173:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399921.593932:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713152:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399921.594272:0:29500:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29500:1832281081713216:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399921.594418:0:29500:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399921.598855:0:29500:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29500:1832281081713216:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399921.598918:0:29500:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399921.598928:0:29500:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399921.598930:0:29500:0:(obd_config.c:1460:class_process_config()) marker 203 (0x1) lustre-clilov del lustre.689522837 00000020:01000000:3.0:1747399921.598935:0:29500:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399921.598938:0:29500:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399921.599012:0:29500:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29500:1832281081713280:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399921.599132:0:29500:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399921.601038:0:29500:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29500:1832281081713280:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399921.601073:0:29500:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399921.601080:0:29500:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399921.601081:0:29500:0:(obd_config.c:1460:class_process_config()) marker 203 (0x2) lustre-clilov del lustre.689522837 00000040:00080000:3.0:1747399921.601085:0:29500:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 313 count 306 00000020:01000000:2.0:1747399921.601252:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 310-312 (rc=0) 10000000:01000000:2.0:1747399921.601277:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399921.601285:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.601296:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399921.601350:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399921.601353:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399921.601355:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399921.601384:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.601390:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.601397:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399921.601413:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713344:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399921.601474:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399921.602982:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713344:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399921.603002:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.603011:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399921.603077:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713408:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399921.603139:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399921.604423:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713408:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399921.604461:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399921.604467:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399921.604474:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399921.939673:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399921.965691:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399921.965798:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089254848 00000100:00100000:1.0:1747399921.965828:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 152 00000100:00100000:1.0:1747399921.965833:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:10067:x1832281089254848:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399921.965845:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 2/0,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399921.965931:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399921.965935:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:10067:x1832281089254848:12345-192.168.204.160@tcp:104: Request processed in 103us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399921.965941:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 152 00010000:00010000:2.0:1747399921.966074:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399921.966078:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 2/0,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399921.966084:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b458d80 already unused, calling callback (ffffffffa04b1280) 00010000:00010000:2.0:1747399921.966088:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 3/0,0 mode: PR/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399921.966116:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 2/0,0 mode: --/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399921.966121:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399921.966145:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 1/0,0 mode: --/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399921.966150:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b458d80/0xd95e55596abdf0ac lrc: 0/0,0 mode: --/PR res: [0x6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606742 expref: -99 pid: 29447 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399921.966174:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399921.966181:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399921.966183:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081713472:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399921.966183:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399921.967164:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081713472:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1747399922.793017:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399922.793074:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399922.793172:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399922.793189:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089255552 00000100:00100000:1.0:1747399922.793225:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 153 00000100:00100000:1.0:1747399922.793229:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:4733:x1832281089255552:12345-192.168.204.160@tcp:104: 00000100:00100000:0.0:1747399922.793230:0:4656:0:(service.c:3210:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 34 00000100:00100000:0.0:1747399922.793235:0:4656:0:(service.c:3269:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1747399922.793240:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399922.793369:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089255616 00010000:00010000:1.0:1747399922.793381:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399922.793386:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:4733:x1832281089255552:12345-192.168.204.160@tcp:104: Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399922.793392:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 153 00010000:00010000:3.0:1747399922.793418:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399922.793422:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.793435:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399922.793438:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.793443:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399922.793448:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399922.793452:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399922.793541:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.793547:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399922.793560:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.793564:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606899 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.793575:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399922.793576:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399922.793577:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399922.793582:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399922.793595:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081713536:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399922.793712:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 12 00000100:00100000:2.0:1747399922.793716:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:4733:x1832281089255616:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399922.793721:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399922.793745:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1747399922.793748:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:4733:x1832281089255616:12345-192.168.204.160@tcp:104: Request processed in 32us (676us total) trans 0 rc 0/0 00010000:00010000:3.0:1747399922.793751:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1747399922.793752:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 12 00010000:00010000:3.0:1747399922.793754:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.793766:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3cc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399922.793768:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.793772:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399922.793776:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399922.793780:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399922.794064:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.794069:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399922.794086:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.794091:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3cc0/0xd95e55596abdf0d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606892 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399922.794099:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399922.794099:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399922.794101:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399922.794104:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399922.794110:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081713600:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399922.794993:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081713536:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399922.795574:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081713600:192.168.204.160@tcp:103:ldlm_bl_02.0 10000000:01000000:1.0:1747399922.829418:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399922.829434:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 313 10000000:01000000:1.0:1747399922.829438:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399922.829474:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.829495:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.829503:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399922.830731:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399922.830799:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e300 going to sleep for 6 seconds 00000100:00100000:1.0:1747399922.832809:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399922.832826:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.832834:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399922.832899:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713728:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399922.832929:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e300 going to sleep for 6 seconds 00000100:00100000:1.0:1747399922.834468:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713728:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399922.834494:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713792:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399922.834544:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e300 going to sleep for 6 seconds 00000100:00100000:1.0:1747399922.836462:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713792:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399922.836937:0:29518:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29518:1832281081713856:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399922.837002:0:29518:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399922.839943:0:29518:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29518:1832281081713856:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399922.839976:0:29518:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399922.839984:0:29518:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399922.839985:0:29518:0:(obd_config.c:1460:class_process_config()) marker 205 (0x1) lustre-clilov new lustre.68951524028271 00000020:01000000:3.0:1747399922.839990:0:29518:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399922.839992:0:29518:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399922.840008:0:29518:0:(lov_pool.c:313:lov_pool_new()) 68951524028271 is pool #1 00000100:00100000:3.0:1747399922.840034:0:29518:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29518:1832281081713920:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399922.840083:0:29518:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399922.843108:0:29518:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29518:1832281081713920:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399922.843149:0:29518:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399922.843155:0:29518:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399922.843157:0:29518:0:(obd_config.c:1460:class_process_config()) marker 205 (0x2) lustre-clilov new lustre.68951524028271 00000040:00080000:3.0:1747399922.843161:0:29518:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 316 count 309 00000020:01000000:1.0:1747399922.843392:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 313-315 (rc=0) 10000000:01000000:1.0:1747399922.843415:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399922.843421:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.843437:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399922.843445:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399922.843447:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399922.843449:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399922.843474:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.843478:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.843484:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399922.843499:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713984:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399922.843840:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e300 going to sleep for 6 seconds 00000100:00100000:1.0:1747399922.846599:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081713984:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399922.846617:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.846626:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399922.846677:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714048:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399922.846720:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e300 going to sleep for 6 seconds 00000100:00100000:1.0:1747399922.848427:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714048:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399922.848471:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399922.848476:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399922.848485:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399922.941616:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399923.659481:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399923.659484:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399923.659514:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081714176:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399923.659527:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081714112:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399923.659676:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081714240:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399923.662366:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081714176:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399923.662456:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081714240:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399923.664003:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081714112:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747399923.943546:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399924.610779:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399924.610831:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399924.610888:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089258880 00000100:00100000:0.0:1747399924.610934:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 154 00000100:00100000:1.0:1747399924.610939:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089259072 00000100:00100000:0.0:1747399924.610952:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:4922:x1832281089258880:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399924.610969:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399924.610986:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 155 00000100:00100000:1.0:1747399924.610992:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:4922:x1832281089259072:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399924.611007:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399924.611045:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399924.611049:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:4922:x1832281089258880:12345-192.168.204.160@tcp:104: Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399924.611055:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 154 00010000:00010000:3.0:1747399924.611089:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399924.611094:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.612026:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399924.612035:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:4922:x1832281089259072:12345-192.168.204.160@tcp:104: Request processed in 1040us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399924.612042:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 155 00010000:00010000:1.0:1747399924.612070:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1747399924.612072:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.612079:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b458240 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399924.612082:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.612087:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399924.612093:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399924.612102:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399924.612131:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.612135:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399924.612149:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.612153:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606910 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.612164:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399924.612165:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399924.612167:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399924.612185:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081714304:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399924.612321:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b458900 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399924.612323:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399924.612328:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399924.612332:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399924.612335:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399924.612364:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399924.612369:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399924.612379:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399924.612383:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b458900/0xd95e55596abdf0eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606917 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399924.612395:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399924.612396:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399924.612397:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399924.612402:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399924.612410:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081714368:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399924.615671:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081714304:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399924.615697:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081714368:192.168.204.160@tcp:103:ldlm_bl_02.0 10000000:01000000:1.0:1747399924.846435:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399924.846440:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 316 10000000:01000000:1.0:1747399924.846445:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399924.846478:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.846485:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.846492:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399924.846512:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399924.847029:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399924.849697:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399924.849718:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.849727:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399924.849789:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714496:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399924.849879:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399924.851738:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714496:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399924.851798:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714560:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399924.851975:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399924.855209:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714560:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399924.855908:0:29564:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29564:1832281081714624:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399924.856802:0:29564:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399924.860638:0:29564:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29564:1832281081714624:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399924.860675:0:29564:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399924.860682:0:29564:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399924.860684:0:29564:0:(obd_config.c:1460:class_process_config()) marker 207 (0x1) lustre-clilov add lustre.68951524028271.lustre-OST0000_UUID 00000020:01000000:3.0:1747399924.860688:0:29564:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399924.860690:0:29564:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399924.860699:0:29564:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to 68951524028271 as member 1 00000020:01000000:3.0:1747399924.860702:0:29564:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399924.860703:0:29564:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399924.860704:0:29564:0:(obd_config.c:1460:class_process_config()) marker 207 (0x2) lustre-clilov add lustre.68951524028271.lustre-OST0000_UUID 00000020:01000000:3.0:1747399924.860706:0:29564:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399924.860707:0:29564:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399924.860708:0:29564:0:(obd_config.c:1460:class_process_config()) marker 209 (0x1) lustre-clilov add lustre.68951524028271.lustre-OST0001_UUID 00000020:01000000:3.0:1747399924.860710:0:29564:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399924.860711:0:29564:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399924.860712:0:29564:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to 68951524028271 as member 2 00000100:00100000:3.0:1747399924.860735:0:29564:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29564:1832281081714688:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399924.860799:0:29564:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399924.866148:0:29564:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29564:1832281081714688:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399924.866195:0:29564:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399924.866204:0:29564:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399924.866205:0:29564:0:(obd_config.c:1460:class_process_config()) marker 209 (0x2) lustre-clilov add lustre.68951524028271.lustre-OST0001_UUID 00000040:00080000:3.0:1747399924.866209:0:29564:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 322 count 315 00000020:01000000:1.0:1747399924.866491:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 316-321 (rc=0) 10000000:01000000:1.0:1747399924.866516:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399924.866578:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.866590:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399924.866599:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399924.866601:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399924.866604:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399924.866631:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.866647:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.866654:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399924.866676:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714752:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399924.869239:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399924.871926:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714752:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399924.871954:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.871965:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399924.872040:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714816:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399924.872145:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399924.876695:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081714816:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399924.876747:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399924.876755:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399924.876767:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399924.945696:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399925.947505:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1747399926.036224:0:29586:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399926.036248:0:29586:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399926.036263:0:29586:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.036276:0:29586:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399926.036286:0:29586:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399926.036289:0:29586:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399926.036295:0:29586:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3bb0 00010000:00010000:1.0:1747399926.036298:0:29586:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.036304:0:29586:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.036339:0:29586:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.036347:0:29586:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:1.0:1747399926.036350:0:29586:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.036356:0:29586:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399926.036360:0:29586:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800ae996600, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399926.036367:0:29586:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:1.0:1747399926.036382:0:29586:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x200000401:0x15:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399926.036433:0:29586:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.036439:0:29586:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399926.036459:0:29586:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399926.036469:0:29586:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af04c0 x1832281081714944/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399926.036478:0:29586:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.036497:0:29586:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081714944:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.036643:0:29586:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59eb40 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.040674:0:29586:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af04c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081714944:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.040702:0:29586:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040718:0:29586:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040722:0:29586:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040731:0:29586:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040738:0:29586:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040747:0:29586:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040768:0:29586:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040773:0:29586:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399926.040781:0:29586:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a9af04c0 x1832281081714944/t4294967364(4294967364) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:1.0:1747399926.040796:0:29586:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af04c0 x1832281081714944/t4294967364(4294967364) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1747399926.040806:0:29586:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.040825:0:29586:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/21 (0 0) 00000080:00200000:1.0:1747399926.040847:0:29586:0:(namei.c:1416:ll_create_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000080:00200000:1.0:1747399926.040869:0:29586:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x15:0x0](ffff8800af231058) 00000080:00200000:1.0:1747399926.040875:0:29586:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x15:0x0], updating i_size 0 00000080:00200000:1.0:1747399926.040933:0:29586:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x15:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1747399926.040938:0:29586:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0x15:0x0](ffff8800af231058) 00000080:00010000:1.0:1747399926.040940:0:29586:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x15:0x0](ffff8800af231058) for lock 0xd95e55596abdf100 00000080:00200000:1.0:1747399926.040954:0:29586:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x15:0x0](ffff8800af231058), flags 120501 00000002:00100000:1.0:1747399926.040966:0:29586:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af04c0 x1832281081714944/t4294967364(4294967364) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:1.0:1747399926.041040:0:29586:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf100 from it ffff88012d57fb40 00010000:00010000:1.0:1747399926.041043:0:29586:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.041057:0:29586:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.041084:0:29586:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x15:0x0](ffff8800af231058), inode mode 81a4 mask 40 00000080:00200000:1.0:1747399926.041127:0:29586:0:(file.c:4008:ll_file_ioctl()) VFS Op:inode=[0x200000401:0x15:0x0](ffff8800af231058), cmd=4008669a 00000002:00010000:1.0:1747399926.041144:0:29586:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x15:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 040000002 00010000:00010000:1.0:1747399926.041186:0:29586:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.041191:0:29586:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399926.041201:0:29586:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399926.041205:0:29586:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af0980 x1832281081715072/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399926.041211:0:29586:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.041228:0:29586:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af0980 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715072:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.041297:0:29586:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e840 going to sleep for 43 seconds 00000100:00100000:0.0:1747399926.042855:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399926.042955:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089260928 00000100:00100000:1.0:1747399926.042999:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 156 00000100:00100000:1.0:1747399926.043005:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:1600:x1832281089260928:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399926.043019:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.043263:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1747399926.043275:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1747399926.043279:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:1600:x1832281089260928:12345-192.168.204.160@tcp:104: Request processed in 275us (432us total) trans 0 rc 0/0 00010000:00010000:3.0:1747399926.043280:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.043288:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 156 00010000:00010000:3.0:1747399926.043294:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b4586c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399926.043297:0:4666:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.043304:0:4666:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.043331:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399926.043355:0:4666:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x15:0x0]: losing layout lock 00010000:00010000:3.0:1747399926.043391:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.043397:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399926.043432:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.043438:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4586c0/0xd95e55596abdf100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606a13 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.043455:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399926.043456:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399926.043457:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399926.043464:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399926.043479:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081715136:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399926.045083:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081715136:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1747399926.045533:0:29586:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af0980 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715072:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.045548:0:29586:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045564:0:29586:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045569:0:29586:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045575:0:29586:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045580:0:29586:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045585:0:29586:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b458900 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399926.045588:0:29586:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045594:0:29586:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045600:0:29586:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045606:0:29586:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399926.045620:0:29586:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.045625:0:29586:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf107 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399926.045640:0:29586:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8800a9af0980 x1832281081715072/t4294967365(4294967365) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399926.045649:0:29586:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af0980 x1832281081715072/t4294967365(4294967365) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399926.045722:0:29586:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399926.045727:0:29586:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399926.045734:0:29586:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399926.045735:0:29586:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399926.045759:0:29586:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x15:0x0], updating i_size 0 00000002:00100000:1.0:1747399926.045768:0:29586:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af0980 x1832281081715072/t4294967365(4294967365) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399926.045786:0:29586:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af0980 x1832281081715072/t4294967365(4294967365) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1747399926.045804:0:29586:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399926.045808:0:29586:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af0e40 x1832281081715264/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.045838:0:29586:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af0e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715264:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399926.045884:0:29586:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:1.0:1747399926.047655:0:29586:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af0e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715264:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399926.047674:0:29586:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af0980 x1832281081715072/t4294967365(4294967365) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:1.0:1747399926.047705:0:29586:0:(file.c:6088:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000401:0x15:0x0](ffff8800af231058) 00000002:00010000:1.0:1747399926.047711:0:29586:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x15:0x0]) in obj [0x200000401:0x15:0x0], intent: layout flags 0 00010000:00010000:1.0:1747399926.047742:0:29586:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.047747:0:29586:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.047753:0:29586:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1747399926.047764:0:29586:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af1300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715328:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.047803:0:29586:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.049096:0:29586:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af1300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715328:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.049114:0:29586:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.049123:0:29586:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1747399926.049131:0:29586:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8800a9af1300 x1832281081715328/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 376/416 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1747399926.049138:0:29586:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1747399926.049145:0:29586:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.049165:0:29586:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/21 (0 0) 00000080:00010000:1.0:1747399926.049178:0:29586:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x15:0x0](ffff8800af231058) for lock 0xd95e55596abdf10e 00000080:00010000:1.0:1747399926.049188:0:29586:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf10e from it ffff8800b3ee3bf8 00010000:00010000:1.0:1747399926.049190:0:29586:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.049197:0:29586:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.049215:0:29586:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.049221:0:29586:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1747399926.049227:0:29586:0:(file.c:5976:ll_layout_lock_set()) ### file [0x200000401:0x15:0x0](ffff8800af231058) being reconfigured ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399926.049256:0:29586:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x15:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:1.0:1747399926.049260:0:29586:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.049265:0:29586:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399926.049341:0:29586:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x15:0x0](ffff8800af231058) 00000002:00100000:1.0:1747399926.049362:0:29586:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af04c0 x1832281081714944/t4294967364(4294967364) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:1.0:1747399926.049387:0:29586:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399926.049391:0:29586:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af1300 x1832281081715456/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.049403:0:29586:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af1300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715456:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399926.049448:0:29586:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399926.052075:0:29586:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af1300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29586:1832281081715456:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399926.052097:0:29586:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af04c0 x1832281081714944/t4294967364(4294967364) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000080:00200000:1.0:1747399926.057434:0:29587:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399926.057455:0:29587:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399926.057469:0:29587:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.057482:0:29587:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399926.057491:0:29587:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399926.057494:0:29587:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399926.057500:0:29587:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a998fbb0 00010000:00010000:1.0:1747399926.057502:0:29587:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.057507:0:29587:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.057521:0:29587:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.057527:0:29587:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:1.0:1747399926.057529:0:29587:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.057534:0:29587:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399926.057538:0:29587:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b397a900, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399926.057547:0:29587:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:1.0:1747399926.057558:0:29587:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile2,[0x200000401:0x16:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399926.057602:0:29587:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.057608:0:29587:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399926.057619:0:29587:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399926.057630:0:29587:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af17c0 x1832281081715584/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399926.057637:0:29587:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.057656:0:29587:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715584:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.057800:0:29587:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e540 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.060175:0:29587:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715584:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.060198:0:29587:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060216:0:29587:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060222:0:29587:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060230:0:29587:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060252:0:29587:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060262:0:29587:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060269:0:29587:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060274:0:29587:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399926.060281:0:29587:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a9af17c0 x1832281081715584/t4294967368(4294967368) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:1.0:1747399926.060291:0:29587:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af17c0 x1832281081715584/t4294967368(4294967368) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1747399926.060300:0:29587:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060553:0:29587:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/22 (0 0) 00000080:00200000:1.0:1747399926.060575:0:29587:0:(namei.c:1416:ll_create_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000080:00200000:1.0:1747399926.060597:0:29587:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x16:0x0](ffff8800af231818) 00000080:00200000:1.0:1747399926.060603:0:29587:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x16:0x0], updating i_size 0 00000080:00200000:1.0:1747399926.060634:0:29587:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x16:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1747399926.060639:0:29587:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0x16:0x0](ffff8800af231818) 00000080:00010000:1.0:1747399926.060641:0:29587:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x16:0x0](ffff8800af231818) for lock 0xd95e55596abdf115 00000080:00200000:1.0:1747399926.060662:0:29587:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x16:0x0](ffff8800af231818), flags 120501 00000002:00100000:1.0:1747399926.060680:0:29587:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af17c0 x1832281081715584/t4294967368(4294967368) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:1.0:1747399926.060749:0:29587:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf115 from it ffff88012d57fba0 00010000:00010000:1.0:1747399926.060752:0:29587:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060758:0:29587:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.060775:0:29587:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x16:0x0](ffff8800af231818), inode mode 81a4 mask 40 00000080:00200000:1.0:1747399926.060828:0:29587:0:(file.c:4008:ll_file_ioctl()) VFS Op:inode=[0x200000401:0x16:0x0](ffff8800af231818), cmd=4008669a 00000002:00010000:1.0:1747399926.060845:0:29587:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x16:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 040000002 00010000:00010000:1.0:1747399926.060884:0:29587:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.060890:0:29587:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399926.060900:0:29587:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399926.060905:0:29587:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af1c80 x1832281081715712/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399926.060911:0:29587:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.060927:0:29587:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af1c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715712:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.061017:0:29587:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e540 going to sleep for 43 seconds 00000100:00100000:0.0:1747399926.062658:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399926.062786:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089260992 00000100:00100000:1.0:1747399926.062848:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 157 00000100:00100000:1.0:1747399926.062855:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:1600:x1832281089260992:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399926.062875:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.062944:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399926.062949:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7+5:1600:x1832281089260992:12345-192.168.204.160@tcp:104: Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399926.062955:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 157 00010000:00010000:3.0:1747399926.063015:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399926.063020:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.063026:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459440 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399926.063029:0:4665:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.063034:0:4665:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.063038:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399926.063057:0:4665:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x16:0x0]: losing layout lock 00010000:00010000:3.0:1747399926.063084:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.063087:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1747399926.063684:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081715776:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399926.064568:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.064579:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459440/0xd95e55596abdf115 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xb255fa25cf606a52 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.064595:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399926.064596:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399926.064599:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399926.065236:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081715776:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1747399926.065925:0:29587:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af1c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715712:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.065940:0:29587:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.065952:0:29587:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.065959:0:29587:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.065965:0:29587:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.065971:0:29587:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.065977:0:29587:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459d40 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399926.065980:0:29587:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.065987:0:29587:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.066004:0:29587:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.066009:0:29587:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399926.066013:0:29587:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.066017:0:29587:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459d40/0xd95e55596abdf11c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399926.066030:0:29587:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8800a9af1c80 x1832281081715712/t4294967369(4294967369) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399926.066041:0:29587:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af1c80 x1832281081715712/t4294967369(4294967369) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399926.066094:0:29587:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x16:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399926.066101:0:29587:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x16:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399926.066110:0:29587:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x16:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1747399926.066112:0:29587:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x16:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1747399926.066160:0:29587:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x16:0x0], updating i_size 0 00000002:00100000:1.0:1747399926.066172:0:29587:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af1c80 x1832281081715712/t4294967369(4294967369) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399926.066189:0:29587:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af1c80 x1832281081715712/t4294967369(4294967369) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1747399926.066216:0:29587:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399926.066220:0:29587:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af2140 x1832281081715904/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.066248:0:29587:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715904:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399926.066303:0:29587:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399926.067546:0:29587:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715904:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399926.067563:0:29587:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af1c80 x1832281081715712/t4294967369(4294967369) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 592/672 e 0 to 0 dl 1747399970 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:1.0:1747399926.067589:0:29587:0:(file.c:6088:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000401:0x16:0x0](ffff8800af231818) 00000002:00010000:1.0:1747399926.067597:0:29587:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x16:0x0]) in obj [0x200000401:0x16:0x0], intent: layout flags 0 00010000:00010000:1.0:1747399926.067634:0:29587:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.067641:0:29587:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.067651:0:29587:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1747399926.067662:0:29587:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715968:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.067701:0:29587:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.068661:0:29587:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081715968:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.068677:0:29587:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.068688:0:29587:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1747399926.068697:0:29587:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8800a9af2600 x1832281081715968/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 376/416 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1747399926.068714:0:29587:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1747399926.068722:0:29587:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.068731:0:29587:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/22 (0 0) 00000080:00010000:1.0:1747399926.068742:0:29587:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x16:0x0](ffff8800af231818) for lock 0xd95e55596abdf123 00000080:00010000:1.0:1747399926.068748:0:29587:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf123 from it ffff8800a998fbf8 00010000:00010000:1.0:1747399926.068751:0:29587:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.068757:0:29587:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.068770:0:29587:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.068777:0:29587:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 2/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1747399926.068783:0:29587:0:(file.c:5976:ll_layout_lock_set()) ### file [0x200000401:0x16:0x0](ffff8800af231818) being reconfigured ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399926.068824:0:29587:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x16:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:1.0:1747399926.068828:0:29587:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747399926.068833:0:29587:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747399926.068893:0:29587:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x16:0x0](ffff8800af231818) 00000002:00100000:1.0:1747399926.068912:0:29587:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af17c0 x1832281081715584/t4294967368(4294967368) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:1.0:1747399926.068928:0:29587:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399926.068932:0:29587:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af2600 x1832281081716096/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.068943:0:29587:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081716096:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399926.068983:0:29587:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399926.070103:0:29587:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29587:1832281081716096:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399926.070118:0:29587:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af17c0 x1832281081715584/t4294967368(4294967368) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000080:00200000:1.0:1747399926.075223:0:29588:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399926.075247:0:29588:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399926.075262:0:29588:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.075276:0:29588:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399926.075285:0:29588:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399926.075288:0:29588:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399926.075295:0:29588:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9a1bb58 00010000:00010000:1.0:1747399926.075297:0:29588:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.075336:0:29588:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.075351:0:29588:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.075358:0:29588:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399926.075361:0:29588:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.075367:0:29588:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=1536 00000080:00200000:1.0:1747399926.075370:0:29588:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399926.075374:0:29588:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399926.075377:0:29588:0:(namei.c:1935:ll_mkdir()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00000020:00100000:1.0:1747399926.075432:0:29588:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399926.075443:0:29588:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af2ac0 x1832281081716224/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.075466:0:29588:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2ac0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29588:1832281081716224:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:1.0:1747399926.075557:0:29588:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399926.079098:0:29588:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2ac0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29588:1832281081716224:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:2.0:1747399926.079138:0:29588:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8) 00000080:00200000:2.0:1747399926.079141:0:29588:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x17:0x0], updating i_size 512 00000080:00200000:1.0:1747399926.091165:0:29589:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399926.091181:0:29589:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399926.091191:0:29589:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.091201:0:29589:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399926.091209:0:29589:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399926.091211:0:29589:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399926.091216:0:29589:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3bb0 00010000:00010000:1.0:1747399926.091222:0:29589:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.091227:0:29589:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.091239:0:29589:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.091244:0:29589:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:1.0:1747399926.091247:0:29589:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.091253:0:29589:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399926.091255:0:29589:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6d2be00, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399926.091261:0:29589:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:1.0:1747399926.091272:0:29589:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x200000401:0x18:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399926.091330:0:29589:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.091336:0:29589:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399926.091346:0:29589:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399926.091353:0:29589:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af2f80 x1832281081716352/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399926.091359:0:29589:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.091375:0:29589:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716352:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.094538:0:29589:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.102512:0:29589:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716352:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.102535:0:29589:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102546:0:29589:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102550:0:29589:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102555:0:29589:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102561:0:29589:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102565:0:29589:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b459680 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399926.102568:0:29589:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102573:0:29589:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102577:0:29589:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 5/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102582:0:29589:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399926.102586:0:29589:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102590:0:29589:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459680/0xd95e55596abdf12a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399926.102609:0:29589:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff8800a9af2f80 x1832281081716352/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399926.102706:0:29589:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399926.102718:0:29589:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399926.102726:0:29589:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102733:0:29589:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399926.102739:0:29589:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399926.102741:0:29589:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399926.102745:0:29589:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3bb0 00010000:00010000:1.0:1747399926.102746:0:29589:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102751:0:29589:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.102762:0:29589:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.102793:0:29589:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=19 00000080:00200000:1.0:1747399926.102796:0:29589:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.102803:0:29589:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6d2b500, open_flags 1a100, mode 0 opened 0 00000080:00200000:1.0:1747399926.102807:0:29589:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open 00000002:00010000:1.0:1747399926.102825:0:29589:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 0320401 00010000:00010000:1.0:1747399926.102857:0:29589:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.102867:0:29589:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399926.102875:0:29589:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399926.102879:0:29589:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af2f80 x1832281081716480/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399926.102885:0:29589:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.102899:0:29589:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716480:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399926.102968:0:29589:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.109480:0:29589:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716480:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399926.109495:0:29589:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109504:0:29589:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109508:0:29589:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109513:0:29589:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109518:0:29589:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109532:0:29589:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a1c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399926.109534:0:29589:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109539:0:29589:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109544:0:29589:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109549:0:29589:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399926.109552:0:29589:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.109556:0:29589:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a1c0/0xd95e55596abdf131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29589 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399926.109568:0:29589:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a9af2f80 x1832281081716480/t4294967373(4294967373) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399926.109577:0:29589:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af2f80 x1832281081716480/t4294967373(4294967373) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399926.109598:0:29589:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x17:0x0], updating i_size 512 00000080:00200000:1.0:1747399926.109600:0:29589:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x17:0x0](ffff8800af219fd8): rc = 0 00000080:00010000:1.0:1747399926.109603:0:29589:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x17:0x0](ffff8800af219fd8) for lock 0x0 00000080:00200000:1.0:1747399926.109620:0:29589:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8), flags 320400 00000002:00100000:1.0:1747399926.109631:0:29589:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af2f80 x1832281081716480/t4294967373(4294967373) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399926.109687:0:29589:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8), inode mode 41ed mask 44 00000080:00200000:1.0:1747399926.109716:0:29589:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8), cmd=0x4008669a 00000020:00100000:1.0:1747399926.109754:0:29589:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399926.109759:0:29589:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af3440 x1832281081716608/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.109772:0:29589:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af3440 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716608:192.168.204.160@tcp:36:lfs.0 00000100:00100000:1.0:1747399926.110289:0:29589:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.114219:0:29589:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af3440 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716608:192.168.204.160@tcp:36:lfs.0 00000080:00200000:1.0:1747399926.114264:0:29589:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8) 00000002:00100000:1.0:1747399926.114290:0:29589:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af2f80 x1832281081716480/t4294967373(4294967373) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747399926.115377:0:29589:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399926.115384:0:29589:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af3900 x1832281081716736/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.115401:0:29589:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af3900 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716736:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399926.115607:0:29589:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399926.118695:0:29589:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af3900 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29589:1832281081716736:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399926.118718:0:29589:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af2f80 x1832281081716480/t4294967373(4294967373) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:0.0:1747399926.122790:0:29590:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:0.0:1747399926.122806:0:29590:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399926.122831:0:29590:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.122842:0:29590:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1747399926.122852:0:29590:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:0.0:1747399926.122855:0:29590:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:0.0:1747399926.122860:0:29590:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a99abbb0 00010000:00010000:0.0:1747399926.122862:0:29590:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.122867:0:29590:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1747399926.122878:0:29590:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399926.122889:0:29590:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=17 00000080:00200000:0.0:1747399926.122892:0:29590:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399926.122898:0:29590:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:0.0:1747399926.122901:0:29590:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff88012e364c00, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1747399926.122907:0:29590:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open|creat 00000002:00010000:0.0:1747399926.122917:0:29590:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x200000401:0x19:0x0]) in obj [0x200000401:0xa:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1747399926.122959:0:29590:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.122964:0:29590:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1747399926.122972:0:29590:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1747399926.122980:0:29590:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880137119300 x1832281081716864/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1747399926.122986:0:29590:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399926.123003:0:29590:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081716864:192.168.204.160@tcp:101:lfs.0 00000100:00100000:0.0:1747399926.123112:0:29590:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753c00 going to sleep for 43 seconds 00000100:00100000:2.0:1747399926.126074:0:29590:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137119300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081716864:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399926.126092:0:29590:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126105:0:29590:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126110:0:29590:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126116:0:29590:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126121:0:29590:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126127:0:29590:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3cc0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399926.126129:0:29590:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126134:0:29590:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126140:0:29590:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 5/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126145:0:29590:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399926.126155:0:29590:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126160:0:29590:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3cc0/0xd95e55596abdf138 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399926.126194:0:29590:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff880137119300 x1832281081716864/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399926.126293:0:29590:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399926.126306:0:29590:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399926.126340:0:29590:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126348:0:29590:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399926.126357:0:29590:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399926.126360:0:29590:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399926.126363:0:29590:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a99abbb0 00010000:00010000:2.0:1747399926.126365:0:29590:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126370:0:29590:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399926.126380:0:29590:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399926.126386:0:29590:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=19 00000080:00200000:2.0:1747399926.126388:0:29590:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399926.126395:0:29590:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), file ffff8800b6fe4480, open_flags 1a100, mode 0 opened 0 00000080:00200000:2.0:1747399926.126407:0:29590:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=open 00000002:00010000:2.0:1747399926.126414:0:29590:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: open flags 0320401 00010000:00010000:2.0:1747399926.126447:0:29590:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.126452:0:29590:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399926.126461:0:29590:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399926.126465:0:29590:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aa84c0 x1832281081716992/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399926.126471:0:29590:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399926.126486:0:29590:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081716992:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399926.129182:0:29590:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 43 seconds 00000100:00100000:2.0:1747399926.132640:0:29590:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081716992:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399926.132656:0:29590:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132667:0:29590:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132673:0:29590:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132678:0:29590:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132695:0:29590:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132699:0:29590:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7cc0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399926.132702:0:29590:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132707:0:29590:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132711:0:29590:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 5/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132716:0:29590:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399926.132719:0:29590:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.132723:0:29590:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf13f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 29590 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399926.132734:0:29590:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800b3aa84c0 x1832281081716992/t4294967376(4294967376) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1747399926.132743:0:29590:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aa84c0 x1832281081716992/t4294967376(4294967376) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399926.132767:0:29590:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x17:0x0], updating i_size 512 00000080:00200000:2.0:1747399926.132769:0:29590:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x17:0x0](ffff8800af219fd8): rc = 0 00000080:00010000:2.0:1747399926.132772:0:29590:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x17:0x0](ffff8800af219fd8) for lock 0x0 00000080:00200000:2.0:1747399926.132790:0:29590:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8), flags 320400 00000002:00100000:2.0:1747399926.132807:0:29590:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aa84c0 x1832281081716992/t4294967376(4294967376) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399926.132869:0:29590:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8), inode mode 41ed mask 44 00000080:00200000:2.0:1747399926.132900:0:29590:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8), cmd=0x4008669a 00000020:00100000:2.0:1747399926.132935:0:29590:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399926.132940:0:29590:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aa9c80 x1832281081717120/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399926.132955:0:29590:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081717120:192.168.204.160@tcp:36:lfs.0 00000100:00100000:2.0:1747399926.133010:0:29590:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 43 seconds 00000100:00100000:2.0:1747399926.136875:0:29590:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081717120:192.168.204.160@tcp:36:lfs.0 00000080:00200000:2.0:1747399926.136913:0:29590:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8) 00000002:00100000:2.0:1747399926.136937:0:29590:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800b3aa84c0 x1832281081716992/t4294967376(4294967376) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:2.0:1747399926.136953:0:29590:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399926.136956:0:29590:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aa97c0 x1832281081717248/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399926.136966:0:29590:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081717248:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747399926.137007:0:29590:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399926.139423:0:29590:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29590:1832281081717248:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399926.139444:0:29590:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800b3aa84c0 x1832281081716992/t4294967376(4294967376) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:2.0:1747399926.145700:0:29591:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399926.145722:0:29591:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399926.145735:0:29591:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.145758:0:29591:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399926.145768:0:29591:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399926.145770:0:29591:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399926.145775:0:29591:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3af8 00010000:00010000:2.0:1747399926.145777:0:29591:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.145782:0:29591:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399926.145799:0:29591:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399926.145804:0:29591:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:2.0:1747399926.145806:0:29591:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399926.145823:0:29591:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:2.0:1747399926.145826:0:29591:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:2.0:1747399926.145832:0:29591:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1747399926.145872:0:29591:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.145877:0:29591:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.145883:0:29591:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399926.145907:0:29591:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29591:1832281081717312:192.168.204.160@tcp:101:rm.0 00000100:00100000:2.0:1747399926.145991:0:29591:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 43 seconds 00000100:00100000:2.0:1747399926.149507:0:29591:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29591:1832281081717312:192.168.204.160@tcp:101:rm.0 00010000:00010000:2.0:1747399926.149526:0:29591:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.149537:0:29591:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.149543:0:29591:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.149550:0:29591:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.149557:0:29591:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.149563:0:29591:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.149568:0:29591:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.149572:0:29591:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399926.149579:0:29591:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800b3aa97c0 x1832281081717312/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/712 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:2.0:1747399926.149587:0:29591:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1747399926.149608:0:29591:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399926.149616:0:29591:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/21 (0 0) 00000080:00200000:2.0:1747399926.149649:0:29591:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x15:0x0](ffff8800af231058): rc = 0 00000080:00200000:2.0:1747399926.149657:0:29591:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x15:0x0]: layout version change: 0 -> 0 00000080:00010000:2.0:1747399926.149661:0:29591:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x15:0x0](ffff8800af231058) for lock 0xd95e55596abdf146 00000080:00010000:2.0:1747399926.149669:0:29591:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x15:0x0](ffff8800af231058) 00000080:00010000:2.0:1747399926.149671:0:29591:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf146 from it ffff8800b3ee3bb8 00010000:00010000:2.0:1747399926.149673:0:29591:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399926.149678:0:29591:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399926.149706:0:29591:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x15:0x0](ffff8800af231058),name=testfile1 00000002:00010000:2.0:1747399926.149715:0:29591:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x15:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1747399926.149720:0:29591:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399926.149725:0:29591:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1747399926.149731:0:29591:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x15:0x0](ffff8800af231058) 00000080:00010000:2.0:1747399926.149733:0:29591:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x15:0x0](ffff8800af231058) for lock 0xd95e55596abdf146 00000080:00010000:2.0:1747399926.149735:0:29591:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf146 from it ffff8800b3ee3cf8 00010000:00010000:2.0:1747399926.149736:0:29591:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1747399926.149746:0:29591:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1747399926.149759:0:29591:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x15:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1747399926.149766:0:29591:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000401:0x15:0x0] 00000008:00010000:2.0:1747399926.149778:0:29591:0:(lustre_osc.h:181:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1747399926.149779:0:29591:0:(osc_lock.c:1241:osc_lock_init()) ### lock ffff8800b3a1f830, osc lock ffff88012e262130, flags 0x400001002 00010000:00010000:2.0:1747399926.149799:0:29591:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 3/1,0 mode: --/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.149805:0:29591:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 3/1,0 mode: --/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1747399926.149866:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399926.149879:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081717376:192.168.204.160@tcp:101:rm.0 00010000:00010000:2.0:1747399926.152696:0:1865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 6/2,0 mode: --/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.152713:0:1865:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 6/2,0 mode: --/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.152722:0:1865:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 6/2,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.152730:0:1865:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 6/2,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1747399926.152750:0:1865:0:(osc_lock.c:196:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 5/2,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.153096:0:1865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 6/2,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.153102:0:1865:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 5/1,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.153107:0:1865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 5/1,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399926.153112:0:1865:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 4/0,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1747399926.153126:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081717376:192.168.204.160@tcp:101:rm.0 00000080:00200000:3.0:1747399926.153223:0:29591:0:(file.c:1496:ll_merge_attr()) [0x200000401:0x15:0x0] updating i_size 0 00000020:00010000:3.0:1747399926.153227:0:29591:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff88012b474d50 (ffff88012b753488/0) at cl_lock_release():234 00000020:00010000:3.0:1747399926.153234:0:29591:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff88012b474d50 (ffff88012b753488/0) at cl_lock_cancel():151 00000020:00010000:3.0:1747399926.153238:0:29591:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b3a1f830 (ffff88012b7535a8/1) at cl_lock_cancel():151 00000020:00010000:3.0:1747399926.153241:0:29591:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff88012b474d50 (ffff88012b753488/0) at cl_lock_fini():84 00000020:00010000:3.0:1747399926.153242:0:29591:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b3a1f830 (ffff88012b753488/1) at cl_lock_fini():84 00000080:00200000:3.0:1747399926.153253:0:29591:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x15:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0 00000080:00200000:3.0:1747399926.153347:0:29591:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399926.153358:0:29591:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399926.153367:0:29591:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.153374:0:29591:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399926.153381:0:29591:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399926.153383:0:29591:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399926.153386:0:29591:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3b90 00010000:00010000:3.0:1747399926.153387:0:29591:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399926.153391:0:29591:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399926.153397:0:29591:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399926.153402:0:29591:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:3.0:1747399926.153403:0:29591:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399926.153407:0:29591:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=testfile1, flags=0 00000080:00200000:3.0:1747399926.153409:0:29591:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399926.153412:0:29591:0:(namei.c:2063:ll_unlink()) VFS Op:name=testfile1, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:3.0:1747399926.153428:0:29591:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1747399926.153445:0:29591:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x15:0x0]: losing layout lock 00010000:00010000:3.0:1747399926.153453:0:29591:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1747399926.153458:0:29591:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x15:0x0]: losing layout lock 00010000:00010000:3.0:1747399926.153476:0:29591:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399926.153480:0:29591:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399926.153485:0:29591:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1747399926.153486:0:29591:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f7a80/0xd95e55596abdf146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606b0f expref: -99 pid: 29591 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1747399926.153506:0:29591:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459200/0xd95e55596abdf10e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606a36 expref: -99 pid: 29586 timeout: 0 lvb_type: 3 00000020:00100000:3.0:1747399926.153520:0:29591:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399926.153525:0:29591:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf617c0 x1832281081717504/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399926.153539:0:29591:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29591:1832281081717504:192.168.204.160@tcp:36:rm.0 00000100:00100000:3.0:1747399926.153888:0:29591:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 43 seconds 00000100:00100000:3.0:1747399926.157236:0:29591:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29591:1832281081717504:192.168.204.160@tcp:36:rm.0 00000080:00200000:3.0:1747399926.157274:0:29591:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1747399926.157282:0:29591:0:(lov_io.c:825:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1747399926.157300:0:29591:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:3.0:1747399926.157333:0:29591:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0x15:0x0](ffff8800af231058) 00000008:00010000:3.0:1747399926.157357:0:29591:0:(osc_object.c:224:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 0 blocks 1 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 1/0,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1747399926.168900:0:29592:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:0.0:1747399926.168916:0:29592:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399926.168926:0:29592:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.168936:0:29592:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1747399926.168945:0:29592:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:0.0:1747399926.168950:0:29592:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:0.0:1747399926.168955:0:29592:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a99abaf8 00010000:00010000:0.0:1747399926.168958:0:29592:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.168963:0:29592:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1747399926.168974:0:29592:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399926.168979:0:29592:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:0.0:1747399926.168981:0:29592:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399926.168985:0:29592:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:0.0:1747399926.168988:0:29592:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:0.0:1747399926.168993:0:29592:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile2,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1747399926.169023:0:29592:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.169028:0:29592:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.169034:0:29592:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399926.169050:0:29592:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29592:1832281081717568:192.168.204.160@tcp:101:rm.0 00000100:00100000:0.0:1747399926.169115:0:29592:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753cc0 going to sleep for 43 seconds 00000100:00100000:0.0:1747399926.172710:0:29592:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29592:1832281081717568:192.168.204.160@tcp:101:rm.0 00010000:00010000:0.0:1747399926.172727:0:29592:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.172749:0:29592:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.172754:0:29592:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.172761:0:29592:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.172772:0:29592:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.172784:0:29592:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.172789:0:29592:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.172793:0:29592:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1747399926.172800:0:29592:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88013711aac0 x1832281081717568/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/712 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:0.0:1747399926.172807:0:29592:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1747399926.172824:0:29592:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399926.172839:0:29592:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/22 (0 0) 00000080:00200000:0.0:1747399926.172876:0:29592:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x16:0x0](ffff8800af231818): rc = 0 00000080:00200000:0.0:1747399926.172885:0:29592:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x16:0x0]: layout version change: 0 -> 0 00000080:00010000:0.0:1747399926.172888:0:29592:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x16:0x0](ffff8800af231818) for lock 0xd95e55596abdf154 00000080:00010000:0.0:1747399926.172897:0:29592:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x16:0x0](ffff8800af231818) 00000080:00010000:0.0:1747399926.172899:0:29592:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf154 from it ffff8800a99abbb8 00010000:00010000:0.0:1747399926.172900:0:29592:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399926.172905:0:29592:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399926.172934:0:29592:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x16:0x0](ffff8800af231818),name=testfile2 00000002:00010000:0.0:1747399926.172943:0:29592:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x16:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1747399926.172947:0:29592:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399926.172953:0:29592:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1747399926.172958:0:29592:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x16:0x0](ffff8800af231818) 00000080:00010000:0.0:1747399926.172960:0:29592:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x16:0x0](ffff8800af231818) for lock 0xd95e55596abdf154 00000080:00010000:0.0:1747399926.172962:0:29592:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf154 from it ffff8800a99abcf8 00010000:00010000:0.0:1747399926.172963:0:29592:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399926.172967:0:29592:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399926.172982:0:29592:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x16:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1747399926.172989:0:29592:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000401:0x16:0x0] 00000008:00010000:0.0:1747399926.173007:0:29592:0:(lustre_osc.h:181:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1747399926.173009:0:29592:0:(osc_lock.c:1241:osc_lock_init()) ### lock ffff8801376230b0, osc lock ffff8800b5a62000, flags 0x400001002 00010000:00010000:0.0:1747399926.173026:0:29592:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 3/1,0 mode: --/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1747399926.173031:0:29592:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 3/1,0 mode: --/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1747399926.173114:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081717632:192.168.204.160@tcp:101:rm.0 00010000:00010000:1.0:1747399926.175536:0:1862:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 6/2,0 mode: --/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399926.175562:0:1862:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 6/2,0 mode: --/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399926.175571:0:1862:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 6/2,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399926.175579:0:1862:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 6/2,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1747399926.175589:0:1862:0:(osc_lock.c:196:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 5/2,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399926.175600:0:1862:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 6/2,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399926.175604:0:1862:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 5/1,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399926.175610:0:1862:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 5/1,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1747399926.175615:0:1862:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 4/0,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1747399926.175628:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081717632:192.168.204.160@tcp:101:rm.0 00000080:00200000:0.0:1747399926.175707:0:29592:0:(file.c:1496:ll_merge_attr()) [0x200000401:0x16:0x0] updating i_size 0 00000020:00010000:0.0:1747399926.175711:0:29592:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff88012e9f0b18 (ffff8801368b6368/0) at cl_lock_release():234 00000020:00010000:0.0:1747399926.175714:0:29592:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff88012e9f0b18 (ffff8801368b6368/0) at cl_lock_cancel():151 00000020:00010000:0.0:1747399926.175717:0:29592:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8801376230b0 (ffff8801368b6488/1) at cl_lock_cancel():151 00000020:00010000:0.0:1747399926.175720:0:29592:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff88012e9f0b18 (ffff8801368b6368/0) at cl_lock_fini():84 00000020:00010000:0.0:1747399926.175721:0:29592:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8801376230b0 (ffff8801368b6368/1) at cl_lock_fini():84 00000080:00200000:0.0:1747399926.175730:0:29592:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x16:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0 00000080:00200000:0.0:1747399926.175801:0:29592:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:0.0:1747399926.175825:0:29592:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399926.175834:0:29592:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.175841:0:29592:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1747399926.175848:0:29592:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:0.0:1747399926.175850:0:29592:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:0.0:1747399926.175854:0:29592:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a99abb90 00010000:00010000:0.0:1747399926.175859:0:29592:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.175864:0:29592:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1747399926.175871:0:29592:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399926.175877:0:29592:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:0.0:1747399926.175879:0:29592:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399926.175884:0:29592:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=testfile2, flags=0 00000080:00200000:0.0:1747399926.175886:0:29592:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:0.0:1747399926.175891:0:29592:0:(namei.c:2063:ll_unlink()) VFS Op:name=testfile2, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:0.0:1747399926.175909:0:29592:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399926.175922:0:29592:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x16:0x0]: losing layout lock 00010000:00010000:0.0:1747399926.175930:0:29592:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1747399926.175936:0:29592:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x16:0x0]: losing layout lock 00010000:00010000:0.0:1747399926.175955:0:29592:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399926.175959:0:29592:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399926.175963:0:29592:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1747399926.175965:0:29592:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f3840/0xd95e55596abdf154 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606b4e expref: -99 pid: 29592 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1747399926.175974:0:29592:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b458900/0xd95e55596abdf123 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xb255fa25cf606a75 expref: -99 pid: 29587 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1747399926.175994:0:29592:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1747399926.175998:0:29592:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88013711aac0 x1832281081717760/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1747399926.176013:0:29592:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29592:1832281081717760:192.168.204.160@tcp:36:rm.0 00000100:00100000:0.0:1747399926.176063:0:29592:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753cc0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399926.180629:0:29592:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29592:1832281081717760:192.168.204.160@tcp:36:rm.0 00000080:00200000:2.0:1747399926.181435:0:29592:0:(vvp_io.c:1820:vvp_io_init()) [0x200000401:0x16:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1747399926.181445:0:29592:0:(lov_io.c:825:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1747399926.181464:0:29592:0:(vvp_io.c:313:vvp_io_fini()) [0x200000401:0x16:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:2.0:1747399926.181468:0:29592:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0x16:0x0](ffff8800af231818) 00000008:00010000:2.0:1747399926.181493:0:29592:0:(osc_object.c:224:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 0 blocks 1 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 1/0,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1747399926.185188:0:29593:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399926.185205:0:29593:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399926.185214:0:29593:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.185222:0:29593:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399926.185228:0:29593:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399926.185230:0:29593:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399926.185234:0:29593:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3b98 00010000:00010000:1.0:1747399926.185236:0:29593:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.185240:0:29593:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.185248:0:29593:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.185253:0:29593:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7a.ost-pools, flags=16 00000080:00200000:1.0:1747399926.185254:0:29593:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399926.185258:0:29593:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), flags=0 00000080:00200000:1.0:1747399926.185260:0:29593:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8), intent=getattr 00000002:00010000:1.0:1747399926.185264:0:29593:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testdir,[0x0:0x0:0x0]) in obj [0x200000401:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1747399926.185292:0:29593:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.185296:0:29593:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.185307:0:29593:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399926.185338:0:29593:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af3900 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29593:1832281081717824:192.168.204.160@tcp:101:rmdir.0 00000100:00100000:1.0:1747399926.185964:0:29593:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.188805:0:29593:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af3900 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29593:1832281081717824:192.168.204.160@tcp:101:rmdir.0 00010000:00010000:1.0:1747399926.188832:0:29593:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 4/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188846:0:29593:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188850:0:29593:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188857:0:29593:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188863:0:29593:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188868:0:29593:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188872:0:29593:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188876:0:29593:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399926.188889:0:29593:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a9af3900 x1832281081717824/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747399970 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rmdir.0' 00000002:00010000:1.0:1747399926.188896:0:29593:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188902:0:29593:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/23 (0 0) 00000080:00200000:1.0:1747399926.188919:0:29593:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x17:0x0], updating i_size 512 00000080:00200000:1.0:1747399926.188921:0:29593:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x17:0x0](ffff8800af219fd8): rc = 0 00000080:00010000:1.0:1747399926.188925:0:29593:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x17:0x0](ffff8800af219fd8) for lock 0xd95e55596abdf162 00000080:00010000:1.0:1747399926.188933:0:29593:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x17:0x0](ffff8800af219fd8) 00000080:00010000:1.0:1747399926.188935:0:29593:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf162 from it ffff8800b3ee3d90 00010000:00010000:1.0:1747399926.188936:0:29593:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.188940:0:29593:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399926.188960:0:29593:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0xa:0x0](ffff880136f91fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399926.188967:0:29593:0:(namei.c:1967:ll_rmdir()) VFS Op:name=testdir, dir=[0x200000401:0xa:0x0](ffff880136f91fd8) 00010000:00010000:1.0:1747399926.188979:0:29593:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.189008:0:29593:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399926.189012:0:29593:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399926.189013:0:29593:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b459f80/0xd95e55596abdf162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xb255fa25cf606b8d expref: -99 pid: 29593 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399926.189034:0:29593:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399926.189038:0:29593:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af3900 x1832281081717952/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399926.189052:0:29593:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af3900 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29593:1832281081717952:192.168.204.160@tcp:36:rmdir.0 00000100:00100000:1.0:1747399926.189646:0:29593:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e9c0 going to sleep for 43 seconds 00000100:00100000:1.0:1747399926.192014:0:29593:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af3900 pname:cluuid:pid:xid:nid:opc:job rmdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:29593:1832281081717952:192.168.204.160@tcp:36:rmdir.0 00000080:00200000:1.0:1747399926.192039:0:29593:0:(llite_lib.c:1844:ll_clear_inode()) VFS Op:inode=[0x200000401:0x17:0x0](ffff8800af219fd8) 00000100:00100000:0.0:1747399926.930355:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399926.930406:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399926.930440:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089261632 00000100:00100000:0.0:1747399926.930466:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089261696 00000100:00100000:0.0:1747399926.930474:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 158 00000100:00100000:0.0:1747399926.930478:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:5152:x1832281089261632:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399926.930490:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.930545:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399926.930549:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:5152:x1832281089261632:12345-192.168.204.160@tcp:104: Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399926.930554:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 158 00000100:00100000:0.0:1747399926.930564:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 159 00000100:00100000:0.0:1747399926.930567:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:5152:x1832281089261696:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399926.930570:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930579:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399926.930583:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930589:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b458480 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399926.930592:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.930595:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1747399926.930597:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399926.930597:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:5152:x1832281089261696:12345-192.168.204.160@tcp:104: Request processed in 30us (193us total) trans 0 rc 0/0 10000000:00010000:2.0:1747399926.930601:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399926.930604:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747399926.930608:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 159 00010000:00010000:2.0:1747399926.930627:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930631:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399926.930643:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930647:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b458480/0xd95e55596abdf0f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606995 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930657:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399926.930659:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930662:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b458240 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399926.930668:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399926.930669:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399926.930672:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399926.930675:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399926.930678:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399926.930698:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930702:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399926.930705:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930708:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b458240/0xd95e55596abdf0f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60698e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399926.930716:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399926.930717:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399926.930719:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399926.930731:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081718016:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399926.930914:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081718080:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399926.933823:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081718016:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399926.933848:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081718080:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399926.949706:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399927.952044:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399928.375887:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399928.375974:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1747399928.375980:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399928.375997:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089264448 00000100:00100000:1.0:1747399928.376039:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 160 00000100:00100000:1.0:1747399928.376044:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8020:x1832281089264448:12345-192.168.204.160@tcp:104: 00000100:00100000:2.0:1747399928.376102:0:4658:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1747399928.376112:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089264512 00010000:00010000:1.0:1747399928.376131:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 2/0,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1747399928.376259:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 13 00000100:00100000:2.0:1747399928.376263:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafda850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:10067:x1832281089264512:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399928.376281:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 2/0,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399928.376358:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1747399928.376363:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafda850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:10067:x1832281089264512:12345-192.168.204.160@tcp:104: Request processed in 99us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1747399928.376368:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 13 00010000:00010000:2.0:1747399928.376419:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399928.376424:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 2/0,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399928.376431:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7cc0 already unused, calling callback (ffffffffa04b1280) 00010000:00010000:2.0:1747399928.376435:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 3/0,0 mode: PR/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399928.376473:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 2/0,0 mode: --/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399928.376479:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399928.376547:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399928.376551:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8020:x1832281089264448:12345-192.168.204.160@tcp:104: Request processed in 507us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399928.376555:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 160 00000100:00100000:3.0:1747399928.376557:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081718144:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399928.376602:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399928.376605:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 2/0,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399928.376611:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3a80 already unused, calling callback (ffffffffa04b1280) 00010000:00010000:3.0:1747399928.376613:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 3/0,0 mode: PR/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399928.376630:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 2/0,0 mode: --/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399928.376635:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399928.376756:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 1/0,0 mode: --/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399928.376762:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012e9f7cc0/0xd95e55596abdf14d lrc: 0/0,0 mode: --/PR res: [0x7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606b16 expref: -99 pid: 29591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1747399928.377732:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399928.377734:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399928.377736:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399928.377782:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081718208:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399928.378202:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 1/0,0 mode: --/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399928.378210:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8800b65c8800 lock: ffff88012b1f3a80/0xd95e55596abdf15b lrc: 0/0,0 mode: --/PR res: [0x8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xb255fa25cf606b55 expref: -99 pid: 29592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1747399928.378239:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399928.378240:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399928.378242:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399928.378834:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081718144:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399928.379077:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081718208:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00080000:2.0:1747399928.667602:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399928.667610:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399928.667647:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081718336:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747399928.667832:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081718272:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399928.669932:0:1864:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967381 gen 1 00000100:00100000:3.0:1747399928.670174:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081718272:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747399928.670206:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081718336:192.168.204.160@tcp:400:kworker/u8:0.0 10000000:01000000:0.0:1747399928.920893:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399928.920900:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 322 10000000:01000000:0.0:1747399928.920905:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399928.920956:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399928.920965:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399928.920975:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399928.921001:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718400:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399928.921101:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753d80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399928.927214:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718400:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399928.927245:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399928.927257:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399928.927366:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718464:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399928.927970:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399928.931168:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718464:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399928.931241:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718528:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399928.931367:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399928.935144:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718528:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399928.936078:0:29616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29616:1832281081718592:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399928.936166:0:29616:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:2.0:1747399928.941388:0:29616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29616:1832281081718592:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:2.0:1747399928.941445:0:29616:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1747399928.941455:0:29616:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1747399928.941457:0:29616:0:(obd_config.c:1460:class_process_config()) marker 211 (0x1) lustre-clilov rem lustre.68951524028271.lustre-OST0000_UUID 00000020:01000000:2.0:1747399928.941466:0:29616:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:2.0:1747399928.941468:0:29616:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1747399928.941543:0:29616:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from 68951524028271 00000100:00100000:2.0:1747399928.941581:0:29616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29616:1832281081718656:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:2.0:1747399928.941694:0:29616:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb840 going to sleep for 6 seconds 00000100:00100000:3.0:1747399928.947754:0:29616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa97c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29616:1832281081718656:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399928.947805:0:29616:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399928.947812:0:29616:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399928.947814:0:29616:0:(obd_config.c:1460:class_process_config()) marker 211 (0x2) lustre-clilov rem lustre.68951524028271.lustre-OST0000_UUID 00000040:00080000:3.0:1747399928.947818:0:29616:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 325 count 318 00000020:01000000:2.0:1747399928.947851:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 322-324 (rc=0) 10000000:01000000:2.0:1747399928.947875:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399928.947882:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399928.947893:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399928.947902:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399928.947904:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399928.947907:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399928.947935:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399928.947941:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399928.947949:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399928.947966:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718720:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399928.948023:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00010000:00010000:0.0:1747399928.953517:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399928.953624:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718720:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399928.953652:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399928.953662:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399928.953733:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718784:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399928.953797:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399928.957265:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718784:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399928.957330:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399928.957336:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399928.957345:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399929.275884:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399929.275941:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399929.275982:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089264640 00000100:00100000:0.0:1747399929.275982:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089264576 00000100:00100000:0.0:1747399929.276019:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 161 00000100:00100000:1.0:1747399929.276025:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 162 00000100:00100000:0.0:1747399929.276025:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:5245:x1832281089264640:12345-192.168.204.160@tcp:104: 00000100:00100000:1.0:1747399929.276028:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:5245:x1832281089264576:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399929.276039:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399929.276039:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399929.276120:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399929.276133:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:5245:x1832281089264576:12345-192.168.204.160@tcp:104: Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399929.276138:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 162 00010000:00010000:2.0:1747399929.276233:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399929.276239:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399929.276245:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399929.276248:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399929.276254:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399929.276259:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399929.276269:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399929.276362:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399929.276366:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:5245:x1832281089264640:12345-192.168.204.160@tcp:104: Request processed in 342us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399929.276375:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 161 00010000:00010000:2.0:1747399929.276409:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399929.276411:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399929.276415:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399929.276415:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399929.276421:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747399929.276423:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399929.276428:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399929.276429:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747399929.276432:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399929.276434:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7840/0xd95e55596abdf170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c27 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399929.276440:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399929.276447:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399929.276448:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399929.276449:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399929.276453:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399929.276454:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1747399929.276457:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747399929.276468:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399929.276469:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081718848:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1747399929.276473:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c20 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399929.276519:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399929.276520:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399929.276521:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399929.276530:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081718912:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1747399929.278904:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081718912:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399929.279154:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081718848:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399929.960811:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399929.995041:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399929.995046:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 325 10000000:01000000:0.0:1747399929.995050:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399929.995090:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399929.995099:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399929.995108:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399929.995126:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718976:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399929.995255:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753cc0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399929.997401:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081718976:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399929.997424:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399929.997434:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399929.997507:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719040:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399929.997579:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399930.000095:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719040:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399930.000230:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719104:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399930.000362:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 5 seconds 00000100:00100000:2.0:1747399930.003291:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719104:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399930.004209:0:29626:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29626:1832281081719168:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399930.004294:0:29626:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399930.007863:0:29626:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29626:1832281081719168:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399930.007912:0:29626:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399930.007922:0:29626:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399930.007923:0:29626:0:(obd_config.c:1460:class_process_config()) marker 213 (0x1) lustre-clilov rem lustre.68951524028271.lustre-OST0001_UUID 00000020:01000000:3.0:1747399930.007937:0:29626:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399930.007940:0:29626:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399930.007954:0:29626:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from 68951524028271 00000100:00100000:3.0:1747399930.008000:0:29626:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29626:1832281081719232:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399930.008079:0:29626:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399930.010002:0:29626:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29626:1832281081719232:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399930.010044:0:29626:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399930.010054:0:29626:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399930.010055:0:29626:0:(obd_config.c:1460:class_process_config()) marker 213 (0x2) lustre-clilov rem lustre.68951524028271.lustre-OST0001_UUID 00000040:00080000:3.0:1747399930.010059:0:29626:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 328 count 321 00000020:01000000:2.0:1747399930.010140:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 325-327 (rc=0) 10000000:01000000:2.0:1747399930.010168:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399930.010175:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399930.010186:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399930.010194:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399930.010196:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399930.010198:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399930.010228:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399930.010234:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399930.010242:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399930.010259:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399930.010343:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399930.011563:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719296:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399930.011583:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399930.011600:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399930.011666:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719360:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399930.011717:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb780 going to sleep for 6 seconds 00000100:00100000:2.0:1747399930.013564:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719360:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399930.013598:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399930.013603:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399930.013610:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399930.959590:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399931.961527:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399932.002568:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399932.002618:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399932.002654:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089268032 00000100:00100000:0.0:1747399932.002689:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089268096 00000100:00100000:0.0:1747399932.002700:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 163 00000100:00100000:0.0:1747399932.002715:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:5405:x1832281089268032:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399932.002732:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399932.002809:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399932.002814:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:5405:x1832281089268032:12345-192.168.204.160@tcp:104: Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399932.002821:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 163 00000100:00100000:0.0:1747399932.002846:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 164 00000100:00100000:0.0:1747399932.002849:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:5405:x1832281089268096:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399932.002855:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399932.002894:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399932.002898:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:5405:x1832281089268096:12345-192.168.204.160@tcp:104: Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399932.002903:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 164 00010000:00010000:2.0:1747399932.002964:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399932.002970:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.002976:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399932.002979:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.002985:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399932.002991:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399932.002995:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399932.003038:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.003043:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399932.003058:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.003063:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6640/0xd95e55596abdf17e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c3c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.003086:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399932.003088:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.003095:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399932.003096:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.003101:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399932.003104:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399932.003108:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399932.003118:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399932.003120:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.003124:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399932.003127:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399932.003131:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606c35 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399932.003140:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081719488:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399932.003145:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399932.003146:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399932.003148:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399932.003155:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081719424:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399932.006082:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081719488:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399932.006470:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081719424:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1747399932.963553:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399933.165414:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399933.165418:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 328 10000000:01000000:1.0:1747399933.165421:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399933.165458:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399933.165466:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399933.165474:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399933.165495:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719552:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399933.167036:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800ab59e0c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399933.170346:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af2f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719552:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399933.170365:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399933.170373:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399933.170431:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719616:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399933.170480:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399933.172753:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719616:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399933.172784:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719680:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399933.173892:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399933.178867:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719680:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399933.179287:0:29720:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29720:1832281081719744:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:2.0:1747399933.179350:0:29720:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:2.0:1747399933.181189:0:29720:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29720:1832281081719744:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:2.0:1747399933.181221:0:29720:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1747399933.181227:0:29720:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1747399933.181228:0:29720:0:(obd_config.c:1460:class_process_config()) marker 215 (0x1) lustre-clilov del lustre.68951524028271 00000020:01000000:2.0:1747399933.181231:0:29720:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:2.0:1747399933.181233:0:29720:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1747399933.181261:0:29720:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29720:1832281081719808:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:2.0:1747399933.181298:0:29720:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399933.182818:0:29720:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa9c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:29720:1832281081719808:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399933.182840:0:29720:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399933.182844:0:29720:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399933.182845:0:29720:0:(obd_config.c:1460:class_process_config()) marker 215 (0x2) lustre-clilov del lustre.68951524028271 00000040:00080000:3.0:1747399933.182848:0:29720:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 331 count 324 00000020:01000000:0.0:1747399933.182894:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 328-330 (rc=0) 10000000:01000000:0.0:1747399933.182913:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399933.182919:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399933.182929:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399933.182936:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399933.182938:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399933.182940:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399933.182957:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399933.182962:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399933.182968:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399933.182979:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399933.183020:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753180 going to sleep for 6 seconds 00000100:00100000:0.0:1747399933.185194:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719872:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1747399933.185210:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399933.185219:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399933.185260:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719936:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747399933.185302:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753180 going to sleep for 6 seconds 00000100:00100000:0.0:1747399933.186413:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081719936:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1747399933.186432:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1747399933.186435:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399933.186440:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1747399933.675433:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399933.675437:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399933.675462:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081720064:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399933.675523:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1747399933.675527:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081720000:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399933.675542:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081720128:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399933.677795:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081720000:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399933.677810:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081720128:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399933.677825:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081720064:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399933.965694:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399934.967635:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747399935.970020:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399936.971900:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399937.973480:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399938.043438:0:30368:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399938.043441:0:30368:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 7b: try to create pool name with invalid lengths or names ========================================================== 08:52:17 (1747399937) 00000100:00080000:1.0:1747399938.683523:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399938.683529:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747399938.683561:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081720192:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399938.683566:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081720256:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399938.683678:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081720320:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399938.686713:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081720256:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399938.686812:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081720192:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399938.686823:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081720320:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:1.0:1747399938.975631:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399939.977525:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399940.979478:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1747399941.569218:0:31030:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1747399941.569229:0:31030:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 7c: create a valid pool name and setstripe with a bad one ========================================================== 08:52:21 (1747399941) 00000080:00200000:2.0:1747399941.626144:0:31041:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399941.626159:0:31041:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399941.626170:0:31041:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.626180:0:31041:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399941.626188:0:31041:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399941.626190:0:31041:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399941.626194:0:31041:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3e00 00010000:00010000:2.0:1747399941.626196:0:31041:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.626201:0:31041:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399941.626212:0:31041:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:2.0:1747399941.626225:0:31041:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399941.626229:0:31041:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399941.626232:0:31041:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.626237:0:31041:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399941.626242:0:31041:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399941.626244:0:31041:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399941.626246:0:31041:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3b58 00010000:00010000:2.0:1747399941.626247:0:31041:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.626252:0:31041:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399941.626258:0:31041:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399941.626412:0:31041:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d7c.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1536 00000080:00200000:3.0:1747399941.626416:0:31041:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399941.626421:0:31041:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399941.626424:0:31041:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.626429:0:31041:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399941.626440:0:31041:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399941.626441:0:31041:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399941.626443:0:31041:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3bf0 00010000:00010000:3.0:1747399941.626444:0:31041:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.626447:0:31041:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399941.626452:0:31041:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399941.626454:0:31041:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399941.626456:0:31041:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399941.626457:0:31041:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.626460:0:31041:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399941.626463:0:31041:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399941.626464:0:31041:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399941.626465:0:31041:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3da0 00010000:00010000:3.0:1747399941.626465:0:31041:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.626468:0:31041:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399941.626470:0:31041:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747399941.626475:0:31041:0:(namei.c:1935:ll_mkdir()) VFS Op:name=d7c.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8) 00000020:00100000:3.0:1747399941.626510:0:31041:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747399941.626516:0:31041:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf604c0 x1832281081720448/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399941.626545:0:31041:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31041:1832281081720448:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:3.0:1747399941.626612:0:31041:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 43 seconds 00000100:00100000:3.0:1747399941.633621:0:31041:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31041:1832281081720448:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:3.0:1747399941.633646:0:31041:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x1a:0x0](ffff880136f92798) 00000080:00200000:3.0:1747399941.633650:0:31041:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1a:0x0], updating i_size 512 00000100:00100000:0.0:1747399941.959796:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399941.959862:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399941.959893:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089271104 00000100:00100000:0.0:1747399941.959929:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089271168 00000100:00100000:0.0:1747399941.959937:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 165 00000100:00100000:0.0:1747399941.959943:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:6930:x1832281089271104:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399941.959957:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399941.960027:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399941.960031:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:6930:x1832281089271104:12345-192.168.204.160@tcp:104: Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399941.960038:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 165 00000100:00100000:1.0:1747399941.960280:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 166 00000100:00100000:1.0:1747399941.960285:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:6930:x1832281089271168:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399941.960292:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.960334:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399941.960340:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.960348:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399941.960351:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.960357:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399941.960363:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399941.960372:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747399941.960542:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399941.960547:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:6930:x1832281089271168:12345-192.168.204.160@tcp:104: Request processed in 261us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399941.960553:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 166 00010000:00010000:3.0:1747399941.960615:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399941.960619:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.960625:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a400 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399941.960627:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.960629:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.960631:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399941.960635:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.960636:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1747399941.960638:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399941.960652:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.960653:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.960656:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399941.960658:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf18c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d15 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.960660:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399941.960671:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a400/0xd95e55596abdf185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d0e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399941.960673:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399941.960674:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399941.960676:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399941.960686:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399941.960687:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399941.960688:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399941.960691:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081720512:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399941.960696:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081720576:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399941.962765:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081720576:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399941.963491:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081720512:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399941.982783:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399942.983528:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399943.260452:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399943.260456:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 331 10000000:01000000:0.0:1747399943.260460:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399943.260502:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399943.260509:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399943.260516:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399943.260533:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720640:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399943.260599:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399943.263420:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720640:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399943.263446:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399943.263456:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399943.263548:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720704:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399943.263620:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399943.266233:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720704:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399943.266297:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720768:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399943.266408:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399943.271566:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720768:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399943.274050:0:31062:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31062:1832281081720832:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399943.274240:0:31062:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399943.276461:0:31062:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31062:1832281081720832:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399943.276502:0:31062:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399943.276508:0:31062:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399943.276510:0:31062:0:(obd_config.c:1460:class_process_config()) marker 217 (0x1) lustre-clilov new lustre.0123456789abcde 00000020:01000000:3.0:1747399943.276515:0:31062:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399943.276516:0:31062:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399943.276530:0:31062:0:(lov_pool.c:313:lov_pool_new()) 0123456789abcde is pool #1 00000100:00100000:3.0:1747399943.276550:0:31062:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31062:1832281081720896:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399943.276602:0:31062:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399943.282299:0:31062:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31062:1832281081720896:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399943.282361:0:31062:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399943.282366:0:31062:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399943.282368:0:31062:0:(obd_config.c:1460:class_process_config()) marker 217 (0x2) lustre-clilov new lustre.0123456789abcde 00000040:00080000:3.0:1747399943.282371:0:31062:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 334 count 327 00000020:01000000:2.0:1747399943.282625:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 331-333 (rc=0) 10000000:01000000:2.0:1747399943.282647:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399943.282652:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399943.282661:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399943.282668:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399943.282670:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399943.282672:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399943.282692:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399943.282697:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399943.282702:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399943.282717:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720960:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399943.282771:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399943.291588:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081720960:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399943.291619:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399943.291641:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399943.291726:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721024:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399943.291888:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb600 going to sleep for 6 seconds 00000100:00100000:2.0:1747399943.293641:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721024:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399943.293688:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399943.293694:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399943.293704:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1747399943.691871:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399943.691878:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747399943.691884:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081721088:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399943.691933:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081721152:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399943.693740:0:1862:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967382 gen 1 00000100:00100000:0.0:1747399943.693763:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081721088:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399943.693868:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081721152:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399943.985467:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399944.733658:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399944.733720:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399944.733825:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399944.733849:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089275008 00000100:00100000:2.0:1747399944.733991:0:4657:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089275200 00000100:00100000:1.0:1747399944.734000:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 167 00000100:00100000:1.0:1747399944.734006:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:7131:x1832281089275008:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399944.734020:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399944.734055:0:4657:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 14 00000100:00100000:2.0:1747399944.734060:0:4657:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+4:7131:x1832281089275200:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399944.734072:0:4657:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399944.734283:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1747399944.734289:0:4657:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399944.734289:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:7131:x1832281089275008:12345-192.168.204.160@tcp:104: Request processed in 282us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1747399944.734294:0:4657:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+4:7131:x1832281089275200:12345-192.168.204.160@tcp:104: Request processed in 233us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399944.734295:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 167 00000100:00100000:2.0:1747399944.734300:0:4657:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 14 00010000:00010000:2.0:1747399944.734354:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399944.734358:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399944.734373:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399944.734375:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399944.734381:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399944.734385:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399944.734388:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399944.734415:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399944.734420:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399944.734529:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399944.734534:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf19a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d38 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399944.734546:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399944.734550:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399944.734554:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399944.734556:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399944.734556:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399944.734557:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399944.734558:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399944.734561:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399944.734564:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399944.734568:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1747399944.734570:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081721216:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399944.734588:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399944.734592:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399944.734595:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399944.734598:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3a80/0xd95e55596abdf193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606d31 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399944.734608:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1747399944.734612:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399944.734612:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081721280:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399944.734613:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399944.734614:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399944.735713:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081721216:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399944.736009:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081721280:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399944.987734:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399945.004469:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399945.004474:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 334 10000000:01000000:0.0:1747399945.004478:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399945.004512:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399945.004523:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399945.004531:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399945.004556:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721344:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399945.004630:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399945.006530:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721344:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399945.006555:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399945.006566:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399945.006641:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721408:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399945.006700:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399945.008897:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721408:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399945.009063:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721472:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399945.009143:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399945.011425:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721472:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399945.012634:0:31107:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31107:1832281081721536:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399945.012715:0:31107:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399945.014770:0:31107:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31107:1832281081721536:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399945.014818:0:31107:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399945.014824:0:31107:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399945.014825:0:31107:0:(obd_config.c:1460:class_process_config()) marker 219 (0x1) lustre-clilov add lustre.0123456789abcde.lustre-OST0000_UUID 00000020:01000000:3.0:1747399945.014831:0:31107:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399945.014833:0:31107:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399945.014843:0:31107:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to 0123456789abcde as member 1 00000020:01000000:3.0:1747399945.014847:0:31107:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399945.014848:0:31107:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399945.014849:0:31107:0:(obd_config.c:1460:class_process_config()) marker 219 (0x2) lustre-clilov add lustre.0123456789abcde.lustre-OST0000_UUID 00000020:01000000:3.0:1747399945.014851:0:31107:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399945.014852:0:31107:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399945.014853:0:31107:0:(obd_config.c:1460:class_process_config()) marker 221 (0x1) lustre-clilov add lustre.0123456789abcde.lustre-OST0001_UUID 00000020:01000000:3.0:1747399945.014855:0:31107:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399945.014856:0:31107:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399945.014858:0:31107:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to 0123456789abcde as member 2 00000100:00100000:3.0:1747399945.014878:0:31107:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31107:1832281081721600:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399945.014941:0:31107:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bb40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399945.016697:0:31107:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31107:1832281081721600:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399945.016736:0:31107:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399945.016743:0:31107:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399945.016744:0:31107:0:(obd_config.c:1460:class_process_config()) marker 221 (0x2) lustre-clilov add lustre.0123456789abcde.lustre-OST0001_UUID 00000040:00080000:3.0:1747399945.016748:0:31107:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 340 count 333 00000020:01000000:2.0:1747399945.016935:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 334-339 (rc=0) 10000000:01000000:2.0:1747399945.016963:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399945.016971:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399945.016981:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399945.016990:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399945.016992:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399945.017002:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399945.017027:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399945.017036:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399945.017044:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399945.017060:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399945.017125:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399945.018621:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399945.018638:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399945.018648:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399945.018698:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721728:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399945.018789:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399945.019956:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081721728:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399945.019989:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399945.019993:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399945.019999:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399945.990643:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1747399946.128163:0:31130:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399946.128182:0:31130:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399946.128193:0:31130:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.128204:0:31130:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399946.128216:0:31130:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399946.128218:0:31130:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399946.128224:0:31130:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3af8 00010000:00010000:3.0:1747399946.128226:0:31130:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.128231:0:31130:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399946.128243:0:31130:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399946.128250:0:31130:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d7c.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=16 00000080:00200000:3.0:1747399946.128253:0:31130:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d7c.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=0 00000002:00010000:3.0:1747399946.128260:0:31130:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d7c.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399946.128290:0:31130:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.128296:0:31130:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.128302:0:31130:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399946.128341:0:31130:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31130:1832281081721792:192.168.204.160@tcp:101:rm.0 00000100:00100000:3.0:1747399946.128492:0:31130:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bd80 going to sleep for 43 seconds 00000100:00100000:3.0:1747399946.131893:0:31130:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31130:1832281081721792:192.168.204.160@tcp:101:rm.0 00010000:00010000:3.0:1747399946.131909:0:31130:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.131928:0:31130:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.131932:0:31130:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.131939:0:31130:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.131945:0:31130:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.131952:0:31130:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.131956:0:31130:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.132008:0:31130:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399946.132017:0:31130:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff88012bf60000 x1832281081721792/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747399990 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:3.0:1747399946.132024:0:31130:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.132031:0:31130:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/26 (0 0) 00000080:00200000:3.0:1747399946.132047:0:31130:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1a:0x0], updating i_size 11776 00000080:00200000:3.0:1747399946.132053:0:31130:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1a:0x0](ffff880136f92798): rc = 0 00000080:00010000:3.0:1747399946.132058:0:31130:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1a:0x0](ffff880136f92798) for lock 0xd95e55596abdf1af 00000080:00010000:3.0:1747399946.132065:0:31130:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x1a:0x0](ffff880136f92798) 00000080:00010000:3.0:1747399946.132067:0:31130:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf1af from it ffff8800b3ee3a68 00010000:00010000:3.0:1747399946.132069:0:31130:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.132074:0:31130:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21d40/0xd95e55596abdf1af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf606e34 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399946.132094:0:31130:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1a:0x0](ffff880136f92798), inode mode 41ed mask 1 00000080:00200000:3.0:1747399946.132102:0:31130:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile1, dir=[0x200000401:0x1a:0x0](ffff880136f92798), flags=0 00000080:00200000:3.0:1747399946.132105:0:31130:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0x1a:0x0](ffff880136f92798), intent=getattr 00000002:00010000:3.0:1747399946.132113:0:31130:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x0:0x0:0x0]) in obj [0x200000401:0x1a:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399946.132135:0:31130:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.132140:0:31130:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.132146:0:31130:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399946.132159:0:31130:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31130:1832281081721856:192.168.204.160@tcp:101:rm.0 00000100:00100000:3.0:1747399946.132206:0:31130:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bd80 going to sleep for 43 seconds 00000100:00100000:3.0:1747399946.133523:0:31130:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31130:1832281081721856:192.168.204.160@tcp:101:rm.0 00010000:00010000:3.0:1747399946.133532:0:31130:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133548:0:31130:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133553:0:31130:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133557:0:31130:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133562:0:31130:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133566:0:31130:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21b00 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399946.133569:0:31130:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133573:0:31130:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133578:0:31130:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133583:0:31130:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399946.133586:0:31130:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133590:0:31130:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21b00/0xd95e55596abdf1b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399946.133608:0:31130:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012bf60000 x1832281081721856/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747399990 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'rm.0' 00010000:00010000:3.0:1747399946.133623:0:31130:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 30 res 8589935617/26 (0 0) 00000080:00200000:3.0:1747399946.133701:0:31130:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399946.133708:0:31130:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399946.133714:0:31130:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133719:0:31130:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399946.133725:0:31130:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399946.133727:0:31130:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399946.133729:0:31130:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800b3ee3b90 00010000:00010000:3.0:1747399946.133731:0:31130:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133736:0:31130:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399946.133744:0:31130:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399946.133748:0:31130:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d7c.ost-pools, flags=16 00000080:00200000:3.0:1747399946.133750:0:31130:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1a:0x0](ffff880136f92798), inode mode 41ed mask 1 00000080:00200000:3.0:1747399946.133755:0:31130:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=testfile1, dir=[0x200000401:0x1a:0x0](ffff880136f92798), flags=0 00000080:00200000:3.0:1747399946.133758:0:31130:0:(namei.c:833:ll_lookup_it()) VFS Op:name=testfile1, dir=[0x200000401:0x1a:0x0](ffff880136f92798), intent=getattr 00000002:00010000:3.0:1747399946.133762:0:31130:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: testfile1,[0x0:0x0:0x0]) in obj [0x200000401:0x1a:0x0], intent: getattr flags 0 00010000:00010000:3.0:1747399946.133783:0:31130:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133792:0:31130:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.133797:0:31130:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399946.133808:0:31130:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31130:1832281081721920:192.168.204.160@tcp:101:rm.0 00000100:00100000:3.0:1747399946.133847:0:31130:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bd80 going to sleep for 43 seconds 00000100:00100000:3.0:1747399946.137050:0:31130:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job rm:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31130:1832281081721920:192.168.204.160@tcp:101:rm.0 00010000:00010000:3.0:1747399946.137069:0:31130:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137081:0:31130:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137087:0:31130:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137091:0:31130:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137097:0:31130:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137102:0:31130:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b218c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399946.137105:0:31130:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137123:0:31130:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137129:0:31130:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137134:0:31130:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399946.137137:0:31130:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.137142:0:31130:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b218c0/0xd95e55596abdf1bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31130 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399946.137156:0:31130:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012bf60000 x1832281081721920/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747399990 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'rm.0' 00010000:00010000:3.0:1747399946.137186:0:31130:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 30 res 8589935617/26 (0 0) 00000100:00100000:0.0:1747399946.741031:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399946.741091:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399946.741131:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089277632 00000100:00100000:0.0:1747399946.741166:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089277888 00000100:00100000:0.0:1747399946.741175:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 168 00000100:00100000:0.0:1747399946.741180:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:7338:x1832281089277632:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399946.741196:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399946.741267:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399946.741272:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:7338:x1832281089277632:12345-192.168.204.160@tcp:104: Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399946.741277:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 168 00000100:00100000:0.0:1747399946.741304:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 169 00000100:00100000:0.0:1747399946.741307:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:7338:x1832281089277888:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399946.741356:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399946.741390:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399946.741394:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:7338:x1832281089277888:12345-192.168.204.160@tcp:104: Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399946.741398:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 169 00010000:00010000:3.0:1747399946.741445:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399946.741449:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399946.741454:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.741455:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399946.741462:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3600 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:3.0:1747399946.741464:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399946.741465:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399946.741466:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399946.741472:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.741474:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399946.741477:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399946.741478:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399946.741483:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1747399946.741498:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399946.741517:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399946.741521:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399946.741538:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399946.741542:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606daf expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399946.741574:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399946.741575:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399946.741577:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399946.741599:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081721984:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399946.741641:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.741646:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399946.741655:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399946.741659:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606db6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399946.741659:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399946.741667:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081722048:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399946.741676:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399946.741677:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399946.741679:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399946.743286:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081722048:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399946.743296:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081721984:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399946.991684:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399947.993702:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399948.659724:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747399948.659727:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 340 10000000:01000000:2.0:1747399948.659730:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747399948.659763:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.659771:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.659779:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399948.659797:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722112:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399948.659966:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399948.661894:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722112:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399948.661919:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.661930:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399948.662021:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722176:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399948.662080:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399948.663647:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722176:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399948.663688:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722240:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399948.664040:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399948.666279:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722240:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399948.666737:0:31161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31161:1832281081722304:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399948.666798:0:31161:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5ba80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399948.668177:0:31161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31161:1832281081722304:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399948.668202:0:31161:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399948.668209:0:31161:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399948.668211:0:31161:0:(obd_config.c:1460:class_process_config()) marker 223 (0x1) lustre-clilov rem lustre.0123456789abcde.lustre-OST0000_UUID 00000020:01000000:3.0:1747399948.668216:0:31161:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399948.668218:0:31161:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399948.668228:0:31161:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from 0123456789abcde 00000020:01000000:3.0:1747399948.668231:0:31161:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399948.668233:0:31161:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399948.668234:0:31161:0:(obd_config.c:1460:class_process_config()) marker 223 (0x2) lustre-clilov rem lustre.0123456789abcde.lustre-OST0000_UUID 00000020:01000000:3.0:1747399948.668235:0:31161:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399948.668237:0:31161:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399948.668243:0:31161:0:(obd_config.c:1460:class_process_config()) marker 225 (0x1) lustre-clilov rem lustre.0123456789abcde.lustre-OST0001_UUID 00000020:01000000:3.0:1747399948.668246:0:31161:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399948.668247:0:31161:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399948.668250:0:31161:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from 0123456789abcde 00000100:00100000:3.0:1747399948.668266:0:31161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31161:1832281081722368:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399948.668343:0:31161:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5ba80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399948.670835:0:31161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31161:1832281081722368:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399948.670864:0:31161:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399948.670870:0:31161:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399948.670872:0:31161:0:(obd_config.c:1460:class_process_config()) marker 225 (0x2) lustre-clilov rem lustre.0123456789abcde.lustre-OST0001_UUID 00000040:00080000:3.0:1747399948.670876:0:31161:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 346 count 339 00000020:01000000:2.0:1747399948.671011:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 340-345 (rc=0) 10000000:01000000:2.0:1747399948.671033:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399948.671039:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.671046:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399948.671055:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399948.671149:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399948.671151:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399948.671173:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.671178:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.671185:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399948.671199:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399948.671561:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399948.675301:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722432:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399948.675336:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.675345:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399948.675412:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722496:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399948.675467:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb480 going to sleep for 6 seconds 00000100:00100000:2.0:1747399948.678329:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722496:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399948.678371:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399948.678376:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399948.678383:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1747399948.699470:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399948.699479:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399948.699488:0:305:0:(import.c:86:import_set_state_nolock()) ffff88012dfe6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:02000000:1.0:1747399948.699492:0:305:0:(import.c:1894:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8800b65c8800: disconnect after 20s idle 00000100:00100000:0.0:1747399948.699506:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081722560:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399948.703475:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081722560:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747399948.706446:0:1861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1861:1832281081722624:192.168.204.160@tcp:9:kworker/u8:3.0 00000100:00080000:3.0:1747399948.708879:0:1861:0:(import.c:1806:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=5: rc = 0 req@ffff8800a9af4c00 x1832281081722624/t0(0) o9->lustre-OST0001-osc-ffff8800b65c8800@192.168.204.160@tcp:28/4 lens 224/224 e 0 to 0 dl 1747399954 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'kworker/u8:3.0' 00000100:00080000:3.0:1747399948.708887:0:1861:0:(import.c:86:import_set_state_nolock()) ffff88012dfe6000 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:3.0:1747399948.708890:0:1861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af4c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1861:1832281081722624:192.168.204.160@tcp:9:kworker/u8:3.0 00010000:00010000:3.0:1747399948.996046:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399949.698453:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399949.698584:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089283136 00000100:00100000:1.0:1747399949.698627:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 170 00000100:00100000:1.0:1747399949.698632:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:7565:x1832281089283136:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399949.698643:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399949.698710:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399949.698714:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:7565:x1832281089283136:12345-192.168.204.160@tcp:104: Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399949.698730:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 170 00010000:00010000:2.0:1747399949.698799:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399949.698805:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.698814:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f73c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399949.698817:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.698823:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399949.698841:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399949.698844:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399949.698879:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.698883:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399949.698911:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.698914:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f73c0/0xd95e55596abdf1cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606f3e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.698925:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399949.698926:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399949.698926:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399949.698940:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399949.698955:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081722688:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1747399949.699267:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399949.699428:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089283648 00000100:00100000:1.0:1747399949.699452:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 171 00000100:00100000:1.0:1747399949.699456:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:7565:x1832281089283648:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399949.699463:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399949.699505:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399949.699509:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:7565:x1832281089283648:12345-192.168.204.160@tcp:104: Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399949.699515:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 171 00010000:00010000:2.0:1747399949.699568:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399949.699571:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.699576:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399949.699577:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.699582:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399949.699594:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399949.699597:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399949.699612:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.699616:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399949.699633:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.699638:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f6f40/0xd95e55596abdf1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606eff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399949.699648:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399949.699649:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399949.699650:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399949.699657:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399949.699664:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081722752:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747399949.701197:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081722688:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399949.701267:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081722752:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399949.997543:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399950.902477:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399950.902482:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 346 10000000:01000000:0.0:1747399950.902487:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399950.902517:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399950.902526:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399950.902535:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399950.902554:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399950.902613:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753b40 going to sleep for 6 seconds 00000100:00100000:0.0:1747399950.907221:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1747399950.907242:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399950.907253:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399950.907341:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747399950.907396:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753b40 going to sleep for 6 seconds 00000100:00100000:0.0:1747399950.912640:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747399950.912686:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1747399950.912738:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753b40 going to sleep for 6 seconds 00000100:00100000:0.0:1747399950.918587:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081722944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399950.920065:0:31265:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31265:1832281081723008:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399950.920121:0:31265:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b000 going to sleep for 6 seconds 00000100:00100000:3.0:1747399950.926475:0:31265:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31265:1832281081723008:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399950.926511:0:31265:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399950.926522:0:31265:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399950.926523:0:31265:0:(obd_config.c:1460:class_process_config()) marker 227 (0x1) lustre-clilov del lustre.0123456789abcde 00000020:01000000:3.0:1747399950.926528:0:31265:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399950.926530:0:31265:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399950.926568:0:31265:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31265:1832281081723072:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399950.926624:0:31265:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399950.930891:0:31265:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31265:1832281081723072:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399950.930928:0:31265:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399950.930933:0:31265:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399950.930935:0:31265:0:(obd_config.c:1460:class_process_config()) marker 227 (0x2) lustre-clilov del lustre.0123456789abcde 00000040:00080000:3.0:1747399950.930938:0:31265:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 349 count 342 00000020:01000000:0.0:1747399950.931132:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 346-348 (rc=0) 10000000:01000000:0.0:1747399950.931151:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399950.931157:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399950.931167:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399950.931175:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399950.931177:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399950.931179:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399950.931203:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399950.931215:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399950.931221:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399950.931236:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399950.931286:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753d80 going to sleep for 6 seconds 00000100:00100000:2.0:1747399950.932932:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399950.932951:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399950.932959:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399950.933008:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723200:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399950.933053:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399950.935173:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723200:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399950.935209:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399950.935215:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399950.935222:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399950.999486:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399952.001767:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399952.980874:0:31796:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399952.980878:0:31796:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 11: OSTs in overlapping/multiple pools ========================================================== 08:52:32 (1747399952) 00010000:00010000:3.0:1747399953.003781:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747399953.310150:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399953.310194:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399953.310233:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089286400 00000100:00100000:1.0:1747399953.310269:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089286464 00000100:00100000:1.0:1747399953.310278:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 172 00000100:00100000:1.0:1747399953.310283:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af50c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:8013:x1832281089286400:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399953.310298:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399953.310479:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 173 00000100:00100000:0.0:1747399953.310484:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:8013:x1832281089286464:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399953.310490:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399953.310540:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399953.310545:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af50c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:8013:x1832281089286400:12345-192.168.204.160@tcp:104: Request processed in 262us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399953.310551:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 172 00010000:00010000:0.0:1747399953.310555:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399953.310558:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:8013:x1832281089286464:12345-192.168.204.160@tcp:104: Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399953.310563:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 173 00010000:00010000:3.0:1747399953.310633:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399953.310637:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399953.310663:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399953.310666:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399953.310672:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3600 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399953.310675:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399953.310682:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399953.310687:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399953.310692:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399953.310735:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399953.310740:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399953.310769:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399953.310774:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3600/0xd95e55596abdf1d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606fae expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399953.310803:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399953.310805:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399953.310806:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399953.310822:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081723264:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399953.310935:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f33c0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399953.310936:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399953.310942:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399953.310946:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399953.310950:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399953.310966:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399953.310981:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399953.310996:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399953.311001:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f33c0/0xd95e55596abdf1d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf606fb5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399953.311016:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399953.311018:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399953.311019:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399953.311225:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081723328:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399953.312610:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081723264:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399953.313470:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf604c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081723328:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1747399953.723683:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081723392:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00080000:1.0:1747399953.723942:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399953.723946:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399953.723960:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399953.723962:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747399953.727998:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081723392:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399954.005599:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399955.007501:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399955.167626:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399955.167633:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 349 10000000:01000000:0.0:1747399955.167638:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399955.167674:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399955.167683:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399955.167705:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399955.168341:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723456:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399955.168424:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753840 going to sleep for 6 seconds 00000100:00100000:2.0:1747399955.170247:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723456:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399955.170265:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399955.170286:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399955.170393:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723520:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399955.170443:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399955.172887:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723520:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399955.172951:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723584:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399955.173037:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399955.175851:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723584:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399955.176964:0:31828:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31828:1832281081723648:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399955.177160:0:31828:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bcc0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399955.179899:0:31828:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31828:1832281081723648:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399955.179952:0:31828:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399955.179963:0:31828:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399955.179965:0:31828:0:(obd_config.c:1460:class_process_config()) marker 229 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747399955.179970:0:31828:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399955.179973:0:31828:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399955.179995:0:31828:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747399955.180029:0:31828:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31828:1832281081723712:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399955.180114:0:31828:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399955.182244:0:31828:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31828:1832281081723712:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399955.182300:0:31828:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399955.182367:0:31828:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399955.182370:0:31828:0:(obd_config.c:1460:class_process_config()) marker 229 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747399955.182527:0:31828:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 353 count 345 00000020:01000000:2.0:1747399955.182891:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 349-352 (rc=0) 10000000:01000000:2.0:1747399955.182914:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399955.182921:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399955.182931:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399955.182939:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399955.182941:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399955.182943:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399955.182967:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399955.182973:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399955.182980:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399955.182997:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723776:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399955.183064:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399955.184629:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723776:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399955.184652:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399955.184663:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399955.184836:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723840:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399955.184975:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb180 going to sleep for 6 seconds 00000100:00100000:2.0:1747399955.186548:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081723840:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399955.186584:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399955.186589:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399955.186598:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399955.999831:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399955.999898:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399956.000594:0:29517:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1747399956.000599:0:4657:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089289344 00000100:00100000:1.0:1747399956.000606:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089289280 00000100:00100000:2.0:1747399956.000678:0:4657:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 15 00000100:00100000:2.0:1747399956.000683:0:4657:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+5:8243:x1832281089289344:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399956.000695:0:4657:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399956.001240:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 174 00000100:00100000:1.0:1747399956.001244:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:8243:x1832281089289280:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399956.001250:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399956.001298:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399956.001303:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:8243:x1832281089289280:12345-192.168.204.160@tcp:104: Request processed in 59us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399956.001337:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 174 00010000:00010000:3.0:1747399956.001592:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399956.001599:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.001609:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f7180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399956.001612:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.001619:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399956.001624:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399956.001629:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399956.001672:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.001677:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399956.001694:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.001698:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f7180/0xd95e55596abdf1e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60702c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.001729:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399956.001730:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399956.001731:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399956.001743:0:4657:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1747399956.001747:0:4657:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:7b80d169-0905-4300-a34c-b155594364e5+3:8243:x1832281089289344:12345-192.168.204.160@tcp:104: Request processed in 1064us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1747399956.001749:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081723904:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747399956.001753:0:4657:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 15 00010000:00010000:2.0:1747399956.001795:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399956.001799:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399956.001805:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399956.001807:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399956.001822:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399956.001827:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399956.001830:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399956.001855:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399956.001859:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399956.001871:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399956.001875:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abdf1e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607025 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399956.001890:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399956.001891:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399956.001892:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399956.001907:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081723968:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399956.004061:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081723968:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399956.004069:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081723904:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399956.009610:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747399956.535462:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747399956.535484:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 353 10000000:01000000:3.0:1747399956.535489:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747399956.535532:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.535542:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.535551:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399956.535574:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724032:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747399956.535657:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399956.540913:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724032:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747399956.540941:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399956.540951:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399956.541025:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724096:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399956.541085:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399956.544342:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724096:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747399956.544387:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724160:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399956.544459:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399956.547109:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724160:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399956.547506:0:31867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31867:1832281081724224:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399956.547558:0:31867:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747399956.550078:0:31867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31867:1832281081724224:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399956.550106:0:31867:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399956.550111:0:31867:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399956.550113:0:31867:0:(obd_config.c:1460:class_process_config()) marker 231 (0x1) lustre-clilov new lustre.testpool2 00000020:01000000:3.0:1747399956.550117:0:31867:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399956.550119:0:31867:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747399956.550132:0:31867:0:(lov_pool.c:313:lov_pool_new()) testpool2 is pool #2 00000100:00100000:3.0:1747399956.550152:0:31867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31867:1832281081724288:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399956.550198:0:31867:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399956.551690:0:31867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31867:1832281081724288:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399956.551708:0:31867:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399956.551712:0:31867:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399956.551713:0:31867:0:(obd_config.c:1460:class_process_config()) marker 231 (0x2) lustre-clilov new lustre.testpool2 00000040:00080000:3.0:1747399956.551715:0:31867:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 356 count 348 00000020:01000000:0.0:1747399956.551898:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 353-355 (rc=0) 10000000:01000000:0.0:1747399956.551913:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747399956.551919:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399956.551927:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747399956.551935:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747399956.551936:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747399956.551938:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747399956.551954:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399956.551958:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399956.551964:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399956.551974:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399956.552009:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b67533c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399956.556880:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399956.556909:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399956.556920:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399956.557008:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724416:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399956.557143:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 6 seconds 00000100:00100000:2.0:1747399956.559603:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724416:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399956.559638:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399956.559644:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399956.559652:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399957.011442:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399957.785606:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399957.785679:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399957.785744:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089292096 00000100:00100000:0.0:1747399957.785782:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089292160 00000100:00100000:0.0:1747399957.785802:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 175 00000100:00100000:0.0:1747399957.785807:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:8430:x1832281089292096:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399957.785819:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399957.785907:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399957.785911:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:8430:x1832281089292096:12345-192.168.204.160@tcp:104: Request processed in 104us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399957.785927:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 175 00010000:00010000:2.0:1747399957.785936:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399957.785940:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399957.785940:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 176 00000100:00100000:0.0:1747399957.785943:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:8430:x1832281089292160:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747399957.785947:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399957.785949:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399957.785954:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399957.785959:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399957.785962:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747399957.785962:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399957.785983:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1747399957.785997:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399957.786001:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1747399957.786002:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:8430:x1832281089292160:12345-192.168.204.160@tcp:104: Request processed in 43us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399957.786007:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 176 00010000:00010000:2.0:1747399957.786020:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399957.786024:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abdf1f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6070a3 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399957.786027:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081724480:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399957.786034:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399957.786035:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399957.786039:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21680 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399957.786040:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399957.786044:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399957.786047:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399957.786050:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399957.786057:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399957.786060:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399957.786062:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399957.786065:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1747399957.786065:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf1ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60709c expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399957.786069:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081724544:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399957.786072:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399957.786073:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399957.786076:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399957.786080:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399957.788436:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081724480:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399957.790031:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aa8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081724544:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399958.014134:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1747399958.731528:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399958.731533:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399958.731535:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399958.731537:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399958.731574:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081724672:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399958.731600:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081724608:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399958.733488:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081724672:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399958.733632:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081724608:192.168.204.160@tcp:400:kworker/u8:3.0 10000000:01000000:0.0:1747399958.839575:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399958.839579:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 356 10000000:01000000:0.0:1747399958.839584:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399958.839613:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399958.839627:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399958.839635:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399958.839658:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724736:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399958.839710:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753600 going to sleep for 6 seconds 00000100:00100000:1.0:1747399958.843711:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724736:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399958.843730:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399958.843744:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399958.843807:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724800:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399958.843870:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34b40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399958.846350:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724800:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399958.846385:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724864:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399958.846444:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34b40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399958.850055:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081724864:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399958.851094:0:31918:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31918:1832281081724928:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399958.851157:0:31918:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399958.854630:0:31918:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31918:1832281081724928:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399958.854660:0:31918:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399958.854667:0:31918:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399958.854668:0:31918:0:(obd_config.c:1460:class_process_config()) marker 233 (0x1) lustre-clilov add lustre.testpool2.lustre-OST0001_UUID 00000020:01000000:3.0:1747399958.854677:0:31918:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399958.854679:0:31918:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399958.854688:0:31918:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool2 as member 1 00000100:00100000:3.0:1747399958.854713:0:31918:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31918:1832281081724992:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399958.854775:0:31918:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399958.859029:0:31918:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31918:1832281081724992:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399958.859064:0:31918:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399958.859075:0:31918:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399958.859077:0:31918:0:(obd_config.c:1460:class_process_config()) marker 233 (0x2) lustre-clilov add lustre.testpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1747399958.859080:0:31918:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 359 count 351 00000020:01000000:1.0:1747399958.859231:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 356-358 (rc=0) 10000000:01000000:1.0:1747399958.859254:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399958.859260:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399958.859269:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399958.859276:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399958.859278:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399958.859280:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399958.859300:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399958.859305:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399958.859396:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399958.859417:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725056:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399958.859990:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34b40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399958.861375:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725056:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399958.861390:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399958.861397:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399958.861437:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725120:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399958.861460:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34b40 going to sleep for 6 seconds 00000100:00100000:1.0:1747399958.863001:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725120:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399958.863030:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399958.863035:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399958.863042:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399959.016123:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399959.144113:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399959.144163:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399959.144228:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089295296 00000100:00100000:0.0:1747399959.144266:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089295360 00000100:00100000:1.0:1747399959.144281:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 177 00000100:00100000:0.0:1747399959.144288:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 178 00000100:00100000:1.0:1747399959.144290:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:8503:x1832281089295296:12345-192.168.204.160@tcp:104: 00000100:00100000:0.0:1747399959.144293:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:8503:x1832281089295360:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399959.144304:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399959.144305:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399959.144410:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399959.144415:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:8503:x1832281089295360:12345-192.168.204.160@tcp:104: Request processed in 122us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399959.144421:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 178 00010000:00010000:1.0:1747399959.144467:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1747399959.144472:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747399959.144477:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399959.144482:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:8503:x1832281089295296:12345-192.168.204.160@tcp:104: Request processed in 194us (378us total) trans 0 rc 0/0 00010000:00010000:2.0:1747399959.144484:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2d00 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399959.144487:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399959.144489:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 177 00010000:00010000:2.0:1747399959.144493:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399959.144497:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399959.144502:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399959.144530:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399959.144535:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399959.144563:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399959.144566:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399959.144572:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399959.144574:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399959.144579:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399959.144583:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399959.144587:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399959.144615:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399959.144619:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399959.144751:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399959.144757:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2d00/0xd95e55596abdf1fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607113 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399959.144782:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399959.144783:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399959.144784:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399959.144792:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399959.144797:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abdf203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60711a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399959.144798:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081725248:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399959.144811:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399959.144812:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399959.144813:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399959.144821:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081725184:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399959.148725:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081725184:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399959.149366:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081725248:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399960.017901:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399960.783411:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399960.783416:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 359 10000000:01000000:1.0:1747399960.783420:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399960.783454:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.783462:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.783469:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399960.783488:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399960.783754:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399960.787023:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399960.787039:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.787046:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399960.787092:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725376:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399960.787133:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399960.789871:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725376:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399960.789912:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725440:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399960.789998:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399960.792183:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725440:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399960.792954:0:31941:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31941:1832281081725504:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399960.793001:0:31941:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399960.797725:0:31941:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31941:1832281081725504:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399960.797760:0:31941:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399960.797768:0:31941:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399960.797770:0:31941:0:(obd_config.c:1460:class_process_config()) marker 235 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747399960.797775:0:31941:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399960.797777:0:31941:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747399960.797785:0:31941:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747399960.797812:0:31941:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31941:1832281081725568:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399960.798140:0:31941:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747399960.800137:0:31941:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:31941:1832281081725568:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399960.800181:0:31941:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399960.800186:0:31941:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399960.800187:0:31941:0:(obd_config.c:1460:class_process_config()) marker 235 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747399960.800190:0:31941:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 362 count 354 00000020:01000000:1.0:1747399960.800258:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 359-361 (rc=0) 10000000:01000000:1.0:1747399960.800277:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399960.800282:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.800291:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399960.800298:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399960.800300:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399960.800302:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399960.800343:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.800348:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.800353:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399960.800364:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725632:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399960.800404:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399960.801573:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725632:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399960.801587:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.801594:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399960.801638:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725696:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399960.801678:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399960.804199:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081725696:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399960.804228:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399960.804233:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399960.804241:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.019762:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1747399961.562436:0:31950:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.562452:0:31950:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.562463:0:31950:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562473:0:31950:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.562481:0:31950:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.562483:0:31950:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.562487:0:31950:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfe00 00010000:00010000:2.0:1747399961.562489:0:31950:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562494:0:31950:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.562505:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:2.0:1747399961.562510:0:31950:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.562512:0:31950:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.562515:0:31950:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562519:0:31950:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.562530:0:31950:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.562531:0:31950:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.562533:0:31950:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfb58 00010000:00010000:2.0:1747399961.562534:0:31950:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562538:0:31950:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.562542:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.562546:0:31950:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d11.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1536 00000080:00200000:2.0:1747399961.562549:0:31950:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.562551:0:31950:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.562553:0:31950:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562556:0:31950:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.562560:0:31950:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.562561:0:31950:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.562562:0:31950:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfbf0 00010000:00010000:2.0:1747399961.562563:0:31950:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562567:0:31950:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.562577:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.562580:0:31950:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.562582:0:31950:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.562584:0:31950:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562587:0:31950:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.562591:0:31950:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.562592:0:31950:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.562593:0:31950:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfda0 00010000:00010000:2.0:1747399961.562594:0:31950:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.562598:0:31950:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.562602:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.562604:0:31950:0:(namei.c:1935:ll_mkdir()) VFS Op:name=d11.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8) 00800000:00000004:2.0:1747399961.562613:0:31950:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800b65c8800: age 136, max_age 0 00000100:00100000:2.0:1747399961.562663:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399961.562677:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081725760:192.168.204.160@tcp:41:mkdir.0 00000020:00100000:2.0:1747399961.563337:0:31950:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399961.563343:0:31950:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aacc00 x1832281081725888/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399961.563353:0:31950:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081725888:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:2.0:1747399961.563374:0:31950:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.565200:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281081725760:192.168.204.160@tcp:41:mkdir.0 00000100:00100000:2.0:1747399961.569662:0:31950:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aacc00 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081725888:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:2.0:1747399961.569691:0:31950:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8) 00000080:00200000:2.0:1747399961.569694:0:31950:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1b:0x0], updating i_size 512 00000080:00200000:2.0:1747399961.569737:0:31950:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.569745:0:31950:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.569755:0:31950:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.569763:0:31950:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.569769:0:31950:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.569771:0:31950:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.569776:0:31950:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfbb0 00010000:00010000:2.0:1747399961.569778:0:31950:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.569783:0:31950:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.569792:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.569800:0:31950:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=d11.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), file ffff8800b64e3200, open_flags 38900, mode 0 opened 0 00000080:00200000:2.0:1747399961.569804:0:31950:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d11.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=open 00000002:00010000:2.0:1747399961.569810:0:31950:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d11.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0704401 00010000:00010000:2.0:1747399961.569836:0:31950:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.569930:0:31950:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399961.569939:0:31950:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399961.569944:0:31950:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aad0c0 x1832281081726016/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399961.569951:0:31950:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399961.569964:0:31950:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081726016:192.168.204.160@tcp:101:mkdir.0 00000100:00100000:2.0:1747399961.570039:0:31950:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.573297:0:31950:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081726016:192.168.204.160@tcp:101:mkdir.0 00010000:00010000:2.0:1747399961.573338:0:31950:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573351:0:31950:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573356:0:31950:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573361:0:31950:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573367:0:31950:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573384:0:31950:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6ac0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399961.573387:0:31950:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573392:0:31950:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573397:0:31950:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573402:0:31950:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399961.573406:0:31950:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.573410:0:31950:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6ac0/0xd95e55596abdf218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31950 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399961.573427:0:31950:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800b3aad0c0 x1832281081726016/t4294967384(4294967384) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000002:00100000:2.0:1747399961.573721:0:31950:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aad0c0 x1832281081726016/t4294967384(4294967384) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:2.0:1747399961.573752:0:31950:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1b:0x0], updating i_size 512 00000080:00200000:2.0:1747399961.573754:0:31950:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1b:0x0](ffff8800af219fd8): rc = 0 00000080:00010000:2.0:1747399961.573759:0:31950:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1b:0x0](ffff8800af219fd8) for lock 0x0 00000080:00200000:2.0:1747399961.573781:0:31950:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), flags 704400 00000002:00100000:2.0:1747399961.573795:0:31950:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aad0c0 x1832281081726016/t4294967384(4294967384) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:2.0:1747399961.573880:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 44 00000080:00200000:2.0:1747399961.573907:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 101 00000080:00200000:2.0:1747399961.573922:0:31950:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8) 00000002:00100000:2.0:1747399961.573948:0:31950:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800b3aad0c0 x1832281081726016/t4294967384(4294967384) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000020:00100000:2.0:1747399961.573972:0:31950:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399961.573977:0:31950:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aac740 x1832281081726144/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399961.573994:0:31950:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081726144:192.168.204.160@tcp:35:mkdir.0 00000100:00100000:2.0:1747399961.574058:0:31950:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399961.576206:0:31950:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081726144:192.168.204.160@tcp:35:mkdir.0 00000002:00100000:2.0:1747399961.576228:0:31950:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800b3aad0c0 x1832281081726016/t4294967384(4294967384) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000080:00200000:2.0:1747399961.576266:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.576276:0:31950:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), flags=1536 00000080:00200000:2.0:1747399961.576279:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.576282:0:31950:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.576285:0:31950:0:(namei.c:1935:ll_mkdir()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8) 00000020:00100000:2.0:1747399961.576354:0:31950:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399961.576359:0:31950:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aac740 x1832281081726272/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399961.576374:0:31950:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081726272:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:2.0:1747399961.577006:0:31950:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.580708:0:31950:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac740 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31950:1832281081726272:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:2.0:1747399961.580737:0:31950:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798) 00000080:00200000:2.0:1747399961.580740:0:31950:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1c:0x0], updating i_size 512 00000080:00200000:2.0:1747399961.583934:0:31951:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.583948:0:31951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.583958:0:31951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.583967:0:31951:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.583973:0:31951:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.583975:0:31951:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.583979:0:31951:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136b0fbb0 00010000:00010000:2.0:1747399961.583980:0:31951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.583984:0:31951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.583992:0:31951:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.583997:0:31951:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d11.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=17 00000080:00200000:2.0:1747399961.583999:0:31951:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d11.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=0 00000002:00010000:2.0:1747399961.584003:0:31951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d11.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.584028:0:31951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.584031:0:31951:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.584042:0:31951:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399961.584056:0:31951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726336:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399961.584117:0:31951:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.587234:0:31951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726336:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399961.587251:0:31951:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587266:0:31951:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587271:0:31951:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587278:0:31951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587286:0:31951:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587293:0:31951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587303:0:31951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587307:0:31951:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399961.587364:0:31951:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800b3aad0c0 x1832281081726336/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1747399961.587373:0:31951:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587381:0:31951:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/27 (0 0) 00000080:00200000:2.0:1747399961.587399:0:31951:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1b:0x0], updating i_size 512 00000080:00200000:2.0:1747399961.587401:0:31951:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1b:0x0](ffff8800af219fd8): rc = 0 00000080:00010000:2.0:1747399961.587405:0:31951:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1b:0x0](ffff8800af219fd8) for lock 0xd95e55596abdf21f 00000080:00010000:2.0:1747399961.587414:0:31951:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x1b:0x0](ffff8800af219fd8) 00000080:00010000:2.0:1747399961.587421:0:31951:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf21f from it ffff880136b0fb20 00010000:00010000:2.0:1747399961.587423:0:31951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587428:0:31951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6d00/0xd95e55596abdf21f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6071e5 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.587453:0:31951:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.587466:0:31951:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.587470:0:31951:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff88012aafa300, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1747399961.587476:0:31951:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open|creat 00000002:00010000:2.0:1747399961.587488:0:31951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir1,[0x200000401:0x1d:0x0]) in obj [0x200000401:0x1b:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1747399961.587519:0:31951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.587524:0:31951:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399961.587537:0:31951:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399961.587542:0:31951:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aad0c0 x1832281081726464/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399961.587547:0:31951:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399961.587562:0:31951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726464:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399961.587641:0:31951:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.589835:0:31951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726464:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399961.589849:0:31951:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.589859:0:31951:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.589864:0:31951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590100:0:31951:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590106:0:31951:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590110:0:31951:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f58c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399961.590113:0:31951:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590128:0:31951:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590133:0:31951:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 5/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590138:0:31951:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399961.590141:0:31951:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590146:0:31951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f58c0/0xd95e55596abdf226 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399961.590171:0:31951:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff8800b3aad0c0 x1832281081726464/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399961.590260:0:31951:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.590274:0:31951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.590281:0:31951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590288:0:31951:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.590295:0:31951:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.590297:0:31951:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.590300:0:31951:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136b0fbb0 00010000:00010000:2.0:1747399961.590302:0:31951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590349:0:31951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.590359:0:31951:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.590364:0:31951:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=19 00000080:00200000:2.0:1747399961.590366:0:31951:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.590372:0:31951:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff88012aafbb00, open_flags 1a100, mode 0 opened 0 00000080:00200000:2.0:1747399961.590376:0:31951:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open 00000002:00010000:2.0:1747399961.590382:0:31951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir1,[0x0:0x0:0x0]) in obj [0x200000401:0x1b:0x0], intent: open flags 0320401 00010000:00010000:2.0:1747399961.590517:0:31951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.590523:0:31951:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399961.590532:0:31951:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399961.590536:0:31951:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aad0c0 x1832281081726592/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399961.590542:0:31951:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399961.590555:0:31951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726592:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747399961.590642:0:31951:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.592709:0:31951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726592:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747399961.592722:0:31951:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592740:0:31951:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592745:0:31951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592751:0:31951:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592756:0:31951:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592760:0:31951:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f6880 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399961.592763:0:31951:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592768:0:31951:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592772:0:31951:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592777:0:31951:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399961.592780:0:31951:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.592784:0:31951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f6880/0xd95e55596abdf22d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31951 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399961.592803:0:31951:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800b3aad0c0 x1832281081726592/t4294967387(4294967387) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1747399961.592811:0:31951:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aad0c0 x1832281081726592/t4294967387(4294967387) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399961.592830:0:31951:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1c:0x0], updating i_size 512 00000080:00200000:2.0:1747399961.592833:0:31951:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1c:0x0](ffff8800af21a798): rc = 0 00000080:00010000:2.0:1747399961.592836:0:31951:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1c:0x0](ffff8800af21a798) for lock 0x0 00000080:00200000:2.0:1747399961.592850:0:31951:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), flags 320400 00000002:00100000:2.0:1747399961.592860:0:31951:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b3aad0c0 x1832281081726592/t4294967387(4294967387) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747399961.592907:0:31951:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), inode mode 41ed mask 44 00000080:00200000:2.0:1747399961.592936:0:31951:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), cmd=0x4008669a 00000020:00100000:2.0:1747399961.592965:0:31951:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399961.592970:0:31951:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aac280 x1832281081726720/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399961.592982:0:31951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726720:192.168.204.160@tcp:36:lfs.0 00000100:00100000:2.0:1747399961.593027:0:31951:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.594710:0:31951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aac280 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726720:192.168.204.160@tcp:36:lfs.0 00000080:00200000:2.0:1747399961.594747:0:31951:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798) 00000002:00100000:2.0:1747399961.594767:0:31951:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800b3aad0c0 x1832281081726592/t4294967387(4294967387) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:2.0:1747399961.594782:0:31951:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747399961.594786:0:31951:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aabdc0 x1832281081726848/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399961.594807:0:31951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726848:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747399961.594842:0:31951:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747399961.596816:0:31951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31951:1832281081726848:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747399961.596836:0:31951:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800b3aad0c0 x1832281081726592/t4294967387(4294967387) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1747399961.601496:0:31952:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399961.601512:0:31952:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399961.601523:0:31952:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.601533:0:31952:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399961.601540:0:31952:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399961.601542:0:31952:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399961.601547:0:31952:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfbb0 00010000:00010000:3.0:1747399961.601549:0:31952:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.601554:0:31952:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399961.601565:0:31952:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399961.601570:0:31952:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=19 00000080:00200000:3.0:1747399961.601573:0:31952:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399961.601578:0:31952:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff8800b6e65e00, open_flags 18800, mode 0 opened 0 00000080:00200000:3.0:1747399961.601583:0:31952:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open 00000002:00010000:3.0:1747399961.601590:0:31952:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir1,[0x0:0x0:0x0]) in obj [0x200000401:0x1b:0x0], intent: open flags 0304001 00010000:00010000:3.0:1747399961.601625:0:31952:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.601634:0:31952:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399961.601644:0:31952:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399961.601652:0:31952:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf617c0 x1832281081726976/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399961.601659:0:31952:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399961.601674:0:31952:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081726976:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399961.601770:0:31952:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399961.603911:0:31952:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081726976:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399961.603923:0:31952:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603932:0:31952:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603937:0:31952:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603941:0:31952:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603946:0:31952:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603960:0:31952:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21680 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399961.603963:0:31952:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603967:0:31952:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603972:0:31952:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603976:0:31952:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399961.603979:0:31952:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.603984:0:31952:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399961.603996:0:31952:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf617c0 x1832281081726976/t4294967390(4294967390) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399961.604004:0:31952:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf617c0 x1832281081726976/t4294967390(4294967390) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399961.604026:0:31952:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1c:0x0], updating i_size 512 00000080:00200000:3.0:1747399961.604028:0:31952:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1c:0x0](ffff8800af21a798): rc = 0 00000080:00010000:3.0:1747399961.604032:0:31952:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1c:0x0](ffff8800af21a798) for lock 0x0 00000080:00200000:3.0:1747399961.604045:0:31952:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), flags 304000 00000002:00100000:3.0:1747399961.604057:0:31952:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf617c0 x1832281081726976/t4294967390(4294967390) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399961.604119:0:31952:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), inode mode 41ed mask 44 00000080:00200000:3.0:1747399961.604142:0:31952:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747399961.604160:0:31952:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747399961.604167:0:31952:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.604173:0:31952:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747399961.604180:0:31952:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747399961.604182:0:31952:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747399961.604184:0:31952:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfbb0 00010000:00010000:3.0:1747399961.604186:0:31952:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.604190:0:31952:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747399961.604199:0:31952:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399961.604202:0:31952:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=16 00000080:00200000:3.0:1747399961.604204:0:31952:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:3.0:1747399961.604210:0:31952:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff8800b6e65800, open_flags 28800, mode 0 opened 0 00000080:00200000:3.0:1747399961.604214:0:31952:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open 00000002:00010000:3.0:1747399961.604218:0:31952:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir1,[0x0:0x0:0x0]) in obj [0x200000401:0x1b:0x0], intent: open flags 0504001 00010000:00010000:3.0:1747399961.604241:0:31952:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.604244:0:31952:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747399961.604253:0:31952:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747399961.604256:0:31952:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf60e40 x1832281081727104/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747399961.604260:0:31952:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399961.604268:0:31952:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727104:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747399961.604412:0:31952:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399961.607075:0:31952:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727104:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747399961.607088:0:31952:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607097:0:31952:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607102:0:31952:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607106:0:31952:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607111:0:31952:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607116:0:31952:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21200 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747399961.607118:0:31952:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607134:0:31952:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607139:0:31952:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607144:0:31952:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747399961.607147:0:31952:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399961.607165:0:31952:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21200/0xd95e55596abdf23b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31952 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747399961.607177:0:31952:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf60e40 x1832281081727104/t4294967391(4294967391) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399961.607185:0:31952:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf60e40 x1832281081727104/t4294967391(4294967391) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399961.607204:0:31952:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1c:0x0], updating i_size 512 00000080:00200000:3.0:1747399961.607207:0:31952:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1c:0x0](ffff8800af21a798): rc = 0 00000080:00010000:3.0:1747399961.607210:0:31952:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1c:0x0](ffff8800af21a798) for lock 0x0 00000080:00200000:3.0:1747399961.607224:0:31952:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), flags 504000 00000002:00100000:3.0:1747399961.607234:0:31952:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf60e40 x1832281081727104/t4294967391(4294967391) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747399961.607248:0:31952:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf60e40 x1832281081727104/t4294967391(4294967391) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:3.0:1747399961.607263:0:31952:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399961.607266:0:31952:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf61300 x1832281081727232/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399961.607283:0:31952:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727232:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399961.608145:0:31952:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399961.610360:0:31952:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727232:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747399961.610379:0:31952:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf60e40 x1832281081727104/t4294967391(4294967391) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747399961.610552:0:31952:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), inode mode 41ed mask 44 00000080:00200000:3.0:1747399961.610574:0:31952:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798) 00000080:00200000:3.0:1747399961.610611:0:31952:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), cmd=0x4008669b 00000100:00100000:3.0:1747399961.610638:0:31952:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727296:192.168.204.160@tcp:33:lfs.0 00000100:00100000:3.0:1747399961.610676:0:31952:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 43 seconds 00000100:00100000:3.0:1747399961.612061:0:31952:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727296:192.168.204.160@tcp:33:lfs.0 00000080:00200000:3.0:1747399961.612357:0:31952:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798) 00000002:00100000:3.0:1747399961.612382:0:31952:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf617c0 x1832281081726976/t4294967390(4294967390) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:3.0:1747399961.612398:0:31952:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747399961.612401:0:31952:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf60e40 x1832281081727424/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747399961.612413:0:31952:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727424:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747399961.612440:0:31952:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399961.613854:0:31952:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31952:1832281081727424:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747399961.613873:0:31952:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf617c0 x1832281081726976/t4294967390(4294967390) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:2.0:1747399961.617923:0:31953:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.617937:0:31953:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.617948:0:31953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.617959:0:31953:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.617966:0:31953:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.617968:0:31953:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.617973:0:31953:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136b0fe00 00010000:00010000:2.0:1747399961.617975:0:31953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.617980:0:31953:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.617990:0:31953:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:2.0:1747399961.617994:0:31953:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.617996:0:31953:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.617999:0:31953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.618007:0:31953:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.618011:0:31953:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.618012:0:31953:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.618014:0:31953:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136b0fb58 00010000:00010000:2.0:1747399961.618015:0:31953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.618018:0:31953:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.618023:0:31953:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.618026:0:31953:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=1536 00000080:00200000:2.0:1747399961.618029:0:31953:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747399961.618032:0:31953:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747399961.618034:0:31953:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.618037:0:31953:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747399961.618041:0:31953:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747399961.618042:0:31953:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747399961.618043:0:31953:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff880136b0fb98 00010000:00010000:2.0:1747399961.618045:0:31953:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.618054:0:31953:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.618059:0:31953:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.618061:0:31953:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=3 00000080:00200000:2.0:1747399961.618063:0:31953:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 101 00000080:00200000:2.0:1747399961.618066:0:31953:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.618069:0:31953:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), flags=1536 00000080:00200000:2.0:1747399961.618071:0:31953:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.618073:0:31953:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.618075:0:31953:0:(namei.c:1935:ll_mkdir()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8) 00000020:00100000:2.0:1747399961.618111:0:31953:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747399961.618120:0:31953:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aabdc0 x1832281081727552/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747399961.618135:0:31953:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31953:1832281081727552:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:2.0:1747399961.618210:0:31953:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.620663:0:31953:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aabdc0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31953:1832281081727552:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:2.0:1747399961.620691:0:31953:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58) 00000080:00200000:2.0:1747399961.620695:0:31953:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1e:0x0], updating i_size 512 00000080:00200000:1.0:1747399961.625550:0:31954:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399961.625566:0:31954:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399961.625578:0:31954:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.625587:0:31954:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399961.625595:0:31954:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399961.625597:0:31954:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399961.625602:0:31954:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfbb0 00010000:00010000:1.0:1747399961.625604:0:31954:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.625609:0:31954:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399961.626034:0:31954:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.626041:0:31954:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=17 00000080:00200000:1.0:1747399961.626045:0:31954:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.626050:0:31954:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 3 00000080:00200000:1.0:1747399961.626052:0:31954:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff8800b6e1b980, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1747399961.626057:0:31954:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open|creat 00000002:00010000:1.0:1747399961.626592:0:31954:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir2,[0x200000401:0x1f:0x0]) in obj [0x200000401:0x1b:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1747399961.626883:0:31954:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.626888:0:31954:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399961.626896:0:31954:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399961.626904:0:31954:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af50c0 x1832281081727680/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399961.626911:0:31954:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399961.626925:0:31954:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081727680:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399961.627038:0:31954:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 43 seconds 00000100:00100000:1.0:1747399961.629224:0:31954:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081727680:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399961.629239:0:31954:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629249:0:31954:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629261:0:31954:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629266:0:31954:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629271:0:31954:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629276:0:31954:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b600 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399961.629279:0:31954:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629283:0:31954:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629288:0:31954:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 5/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629293:0:31954:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399961.629296:0:31954:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629300:0:31954:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b600/0xd95e55596abdf242 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399961.629332:0:31954:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff8800a9af50c0 x1832281081727680/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399961.629720:0:31954:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399961.629812:0:31954:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399961.629821:0:31954:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629828:0:31954:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399961.629835:0:31954:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399961.629837:0:31954:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399961.629842:0:31954:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012b8dfbb0 00010000:00010000:1.0:1747399961.629843:0:31954:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629848:0:31954:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399961.629857:0:31954:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.629863:0:31954:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=19 00000080:00200000:1.0:1747399961.629865:0:31954:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.629873:0:31954:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff8800b6e1b080, open_flags 1a100, mode 0 opened 0 00000080:00200000:1.0:1747399961.629877:0:31954:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open 00000002:00010000:1.0:1747399961.629883:0:31954:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir2,[0x0:0x0:0x0]) in obj [0x200000401:0x1b:0x0], intent: open flags 0320401 00010000:00010000:1.0:1747399961.629908:0:31954:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.629913:0:31954:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399961.629930:0:31954:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399961.629934:0:31954:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af50c0 x1832281081727808/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399961.629939:0:31954:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399961.629951:0:31954:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081727808:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399961.630014:0:31954:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 43 seconds 00000100:00100000:1.0:1747399961.632142:0:31954:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081727808:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399961.632167:0:31954:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632175:0:31954:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632179:0:31954:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632182:0:31954:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632186:0:31954:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632189:0:31954:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b840 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399961.632192:0:31954:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632212:0:31954:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632217:0:31954:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632221:0:31954:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399961.632224:0:31954:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.632228:0:31954:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b840/0xd95e55596abdf249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31954 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399961.632245:0:31954:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a9af50c0 x1832281081727808/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399961.632255:0:31954:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af50c0 x1832281081727808/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399961.632275:0:31954:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1e:0x0], updating i_size 512 00000080:00200000:1.0:1747399961.632277:0:31954:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1e:0x0](ffff8800af21af58): rc = 0 00000080:00010000:1.0:1747399961.632281:0:31954:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1e:0x0](ffff8800af21af58) for lock 0x0 00000080:00200000:1.0:1747399961.632295:0:31954:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), flags 320400 00000002:00100000:1.0:1747399961.632307:0:31954:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af50c0 x1832281081727808/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399961.632382:0:31954:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), inode mode 41ed mask 44 00000080:00200000:1.0:1747399961.632415:0:31954:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), cmd=0x4008669a 00000020:00100000:1.0:1747399961.632452:0:31954:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1747399961.632456:0:31954:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af5580 x1832281081727936/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399961.632475:0:31954:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5580 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081727936:192.168.204.160@tcp:36:lfs.0 00000100:00100000:1.0:1747399961.632528:0:31954:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 43 seconds 00000100:00100000:1.0:1747399961.636886:0:31954:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5580 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081727936:192.168.204.160@tcp:36:lfs.0 00000080:00200000:1.0:1747399961.636951:0:31954:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58) 00000002:00100000:1.0:1747399961.636988:0:31954:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af50c0 x1832281081727808/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747399961.637013:0:31954:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399961.637017:0:31954:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af5f00 x1832281081728064/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399961.637036:0:31954:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081728064:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399961.637093:0:31954:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399961.641031:0:31954:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31954:1832281081728064:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399961.641058:0:31954:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af50c0 x1832281081727808/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1747399961.646880:0:31955:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399961.646895:0:31955:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399961.646906:0:31955:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.646917:0:31955:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399961.646925:0:31955:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399961.646927:0:31955:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399961.646932:0:31955:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ae837bb0 00010000:00010000:1.0:1747399961.646938:0:31955:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.646944:0:31955:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399961.646955:0:31955:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.646961:0:31955:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=19 00000080:00200000:1.0:1747399961.646963:0:31955:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.646968:0:31955:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff8800b64fdc80, open_flags 18800, mode 0 opened 0 00000080:00200000:1.0:1747399961.646972:0:31955:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open 00000002:00010000:1.0:1747399961.646979:0:31955:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir2,[0x0:0x0:0x0]) in obj [0x200000401:0x1b:0x0], intent: open flags 0304001 00010000:00010000:1.0:1747399961.647014:0:31955:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.647019:0:31955:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399961.647027:0:31955:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399961.647035:0:31955:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af5f00 x1832281081728192/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399961.647041:0:31955:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399961.647056:0:31955:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728192:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399961.647167:0:31955:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 43 seconds 00000100:00100000:1.0:1747399961.650686:0:31955:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728192:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399961.650712:0:31955:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650735:0:31955:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650741:0:31955:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650746:0:31955:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650752:0:31955:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650757:0:31955:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45ba80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399961.650761:0:31955:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650767:0:31955:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650773:0:31955:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650782:0:31955:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399961.650787:0:31955:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.650792:0:31955:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abdf250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399961.650823:0:31955:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a9af5f00 x1832281081728192/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399961.650833:0:31955:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af5f00 x1832281081728192/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399961.650863:0:31955:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1e:0x0], updating i_size 512 00000080:00200000:1.0:1747399961.650865:0:31955:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1e:0x0](ffff8800af21af58): rc = 0 00000080:00010000:1.0:1747399961.650870:0:31955:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1e:0x0](ffff8800af21af58) for lock 0x0 00000080:00200000:1.0:1747399961.650889:0:31955:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), flags 304000 00000002:00100000:1.0:1747399961.650903:0:31955:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af5f00 x1832281081728192/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399961.651049:0:31955:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), inode mode 41ed mask 44 00000080:00200000:1.0:1747399961.651084:0:31955:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747399961.651094:0:31955:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747399961.651105:0:31955:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.651114:0:31955:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747399961.651126:0:31955:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747399961.651129:0:31955:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747399961.651132:0:31955:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ae837bb0 00010000:00010000:1.0:1747399961.651134:0:31955:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.651139:0:31955:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747399961.651167:0:31955:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.651173:0:31955:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=16 00000080:00200000:1.0:1747399961.651176:0:31955:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:1.0:1747399961.651183:0:31955:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), file ffff8800b64fc780, open_flags 28800, mode 0 opened 0 00000080:00200000:1.0:1747399961.651188:0:31955:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir2, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=open 00000002:00010000:1.0:1747399961.651195:0:31955:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir2,[0x0:0x0:0x0]) in obj [0x200000401:0x1b:0x0], intent: open flags 0504001 00010000:00010000:1.0:1747399961.651233:0:31955:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.651238:0:31955:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747399961.651246:0:31955:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747399961.651250:0:31955:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af50c0 x1832281081728320/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747399961.651256:0:31955:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399961.651273:0:31955:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728320:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747399961.652057:0:31955:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 43 seconds 00000100:00100000:1.0:1747399961.657628:0:31955:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728320:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747399961.657651:0:31955:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657663:0:31955:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657683:0:31955:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657688:0:31955:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657695:0:31955:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657700:0:31955:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45bcc0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747399961.657703:0:31955:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657709:0:31955:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657715:0:31955:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657720:0:31955:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747399961.657725:0:31955:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399961.657729:0:31955:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45bcc0/0xd95e55596abdf257 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31955 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747399961.657745:0:31955:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a9af50c0 x1832281081728320/t4294967399(4294967399) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399961.657764:0:31955:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af50c0 x1832281081728320/t4294967399(4294967399) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399961.657794:0:31955:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1e:0x0], updating i_size 512 00000080:00200000:1.0:1747399961.657796:0:31955:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1e:0x0](ffff8800af21af58): rc = 0 00000080:00010000:1.0:1747399961.657801:0:31955:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1e:0x0](ffff8800af21af58) for lock 0x0 00000080:00200000:1.0:1747399961.657823:0:31955:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), flags 504000 00000002:00100000:1.0:1747399961.657837:0:31955:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af50c0 x1832281081728320/t4294967399(4294967399) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747399961.657988:0:31955:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af50c0 x1832281081728320/t4294967399(4294967399) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1747399961.658015:0:31955:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399961.658019:0:31955:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af63c0 x1832281081728448/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399961.658037:0:31955:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728448:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399961.658100:0:31955:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399961.660173:0:31955:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728448:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399961.660200:0:31955:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af50c0 x1832281081728320/t4294967399(4294967399) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747399961.660290:0:31955:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), inode mode 41ed mask 44 00000080:00200000:1.0:1747399961.660342:0:31955:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58) 00000080:00200000:1.0:1747399961.660401:0:31955:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58), cmd=0x4008669b 00000100:00100000:1.0:1747399961.660445:0:31955:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728512:192.168.204.160@tcp:33:lfs.0 00000100:00100000:1.0:1747399961.660507:0:31955:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 43 seconds 00000100:00100000:1.0:1747399961.662056:0:31955:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728512:192.168.204.160@tcp:33:lfs.0 00000080:00200000:1.0:1747399961.662222:0:31955:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x1e:0x0](ffff8800af21af58) 00000002:00100000:1.0:1747399961.662252:0:31955:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af5f00 x1832281081728192/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747399961.662274:0:31955:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747399961.662277:0:31955:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af50c0 x1832281081728640/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747399961.662291:0:31955:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728640:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747399961.662373:0:31955:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747399961.663907:0:31955:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31955:1832281081728640:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747399961.663927:0:31955:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af5f00 x1832281081728192/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:0.0:1747399961.679519:0:31956:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:0.0:1747399961.679536:0:31956:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399961.679548:0:31956:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399961.679560:0:31956:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1747399961.679573:0:31956:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:0.0:1747399961.679576:0:31956:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:0.0:1747399961.679581:0:31956:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a9aefbb0 00010000:00010000:0.0:1747399961.679583:0:31956:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399961.679589:0:31956:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1747399961.679600:0:31956:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399961.679606:0:31956:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d11.ost-pools, flags=17 00000080:00200000:0.0:1747399961.679608:0:31956:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1b:0x0](ffff8800af219fd8), inode mode 41ed mask 1 00000080:00200000:0.0:1747399961.679613:0:31956:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), flags=17 00000080:00200000:0.0:1747399961.679616:0:31956:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir1, dir=[0x200000401:0x1b:0x0](ffff8800af219fd8), intent=0 00000002:00010000:0.0:1747399961.679623:0:31956:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir1,[0x0:0x0:0x0]) in obj [0x200000401:0x1b:0x0], intent: lookup flags 0 00010000:00010000:0.0:1747399961.679655:0:31956:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399961.679661:0:31956:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399961.679669:0:31956:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399961.679687:0:31956:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371197c0 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31956:1832281081728704:192.168.204.160@tcp:101:createmany.0 00000100:00100000:0.0:1747399961.680383:0:31956:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753300 going to sleep for 43 seconds 00000100:00100000:2.0:1747399961.682844:0:31956:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371197c0 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31956:1832281081728704:192.168.204.160@tcp:101:createmany.0 00010000:00010000:2.0:1747399961.682866:0:31956:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682882:0:31956:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682900:0:31956:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682917:0:31956:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682925:0:31956:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682935:0:31956:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682940:0:31956:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682945:0:31956:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399961.682952:0:31956:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8801371197c0 x1832281081728704/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'createmany.0' 00000002:00010000:2.0:1747399961.682961:0:31956:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.682968:0:31956:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/28 (0 0) 00000080:00200000:2.0:1747399961.682991:0:31956:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x1c:0x0], updating i_size 512 00000080:00200000:2.0:1747399961.682994:0:31956:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x1c:0x0](ffff8800af21a798): rc = 0 00000080:00010000:2.0:1747399961.682999:0:31956:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x1c:0x0](ffff8800af21a798) for lock 0xd95e55596abdf25e 00000080:00010000:2.0:1747399961.683010:0:31956:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x1c:0x0](ffff8800af21a798) 00000080:00010000:2.0:1747399961.683016:0:31956:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf25e from it ffff8800a9aefb20 00010000:00010000:2.0:1747399961.683018:0:31956:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.683025:0:31956:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b1f2d00/0xd95e55596abdf25e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6072ef expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747399961.683057:0:31956:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), inode mode 41ed mask 1 00000080:00200000:2.0:1747399961.683071:0:31956:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x1c:0x0](ffff8800af21a798), inode mode 41ed mask 3 00000080:00200000:2.0:1747399961.683075:0:31956:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=f11.ost-pools0, dir=[0x200000401:0x1c:0x0](ffff8800af21a798), file ffff8800ae997800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1747399961.683082:0:31956:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f11.ost-pools0, dir=[0x200000401:0x1c:0x0](ffff8800af21a798), intent=open|creat 00000002:00010000:2.0:1747399961.683099:0:31956:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f11.ost-pools0,[0x200000401:0x20:0x0]) in obj [0x200000401:0x1c:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1747399961.683142:0:31956:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399961.683162:0:31956:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747399961.683172:0:31956:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747399961.683177:0:31956:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aad0c0 x1832281081728832/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747399961.683183:0:31956:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399961.683200:0:31956:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31956:1832281081728832:192.168.204.160@tcp:101:createmany.0 00000100:00100000:2.0:1747399961.684226:0:31956:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 43 seconds 00010000:00010000:3.0:1747399962.021484:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399963.023643:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1747399963.740279:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399963.740284:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399963.740285:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399963.740287:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399963.740324:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081728960:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399963.740386:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1747399963.740391:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081728896:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399963.743484:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081728960:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399963.743504:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081728896:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399964.025623:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399965.028720:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399966.029542:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399967.031946:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399968.033518:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1747399968.747802:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399968.747817:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399968.747818:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399968.747820:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399968.747847:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729088:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399968.747911:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1747399968.747916:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081729024:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399968.750805:0:1863:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967401 gen 1 00000100:00100000:1.0:1747399968.750835:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729088:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399968.750958:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081729024:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399969.035520:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399970.038513:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399971.042168:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399972.043505:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399973.046458:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1747399973.755461:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399973.755466:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399973.755468:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399973.755470:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399973.755493:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729216:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399973.755555:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1747399973.755560:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081729152:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399973.757651:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081729152:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399973.757669:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729216:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399974.047478:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399975.051219:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399976.053098:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399977.055558:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399978.058098:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1747399978.763469:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399978.763483:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399978.763485:0:5:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399978.763487:0:5:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747399978.763498:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081729280:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1747399978.763504:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729344:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1747399978.765789:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729344:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1747399978.765842:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081729280:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747399979.059499:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399980.061614:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399981.063719:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399981.686761:0:31956:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:31956:1832281081728832:192.168.204.160@tcp:101:createmany.0 00010000:00010000:2.0:1747399981.686810:0:31956:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686822:0:31956:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686826:0:31956:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686829:0:31956:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686833:0:31956:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686837:0:31956:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5b00 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747399981.686839:0:31956:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686855:0:31956:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686860:0:31956:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 5/0,0 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686864:0:31956:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747399981.686867:0:31956:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399981.686871:0:31956:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012e9f5b00/0xd95e55596abdf265 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1c:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31956 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747399981.686897:0:31956:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=17, status=-28 req@ffff8800b3aad0c0 x1832281081728832/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400005 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'createmany.0' 00000080:00200000:2.0:1747399981.686964:0:31956:0:(namei.c:1416:ll_create_it()) VFS Op:name=f11.ost-pools0, dir=[0x200000401:0x1c:0x0](ffff8800af21a798), intent=open|creat 00010000:00010000:2.0:1747399982.065617:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747399982.125639:0:32104:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747399982.125643:0:32104:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: ost-pools test_11: @@@@@@ FAIL: createmany /mnt/lustre/d11.ost-pools/dir1/f11.ost-pools failed! Debug log: 13315 lines, 13315 kept, 0 dropped, 0 bad.